Adeptia conducts extensive performance testing with each release to ensure improving and better performance of its product. Some performance benchmarks are provided here for references:
- Test A - Large number of small files (EDI)
- Test B - Large sized EDI (no Large Data Ingestion)
- Test C - Large file processing with Large Data Ingestion
- Test D - UI Load Testing with Concurrent Users
Test A - Large Number of Small EDI Files
System Configuration
- Cluster = 2 nodes (Kernel + WebRunner)
- Processor = Intel Xeon CPU E5-2686 2.30GHz
- Number Of Cores = 4
- Total RAM = 15GB
- OS = Windows Server 2012 R2 64-bit
- Backend / Log Database - AWS SQL RDS
- Kernel = 8GB
Result - All tests ran successfully
Scenario | File Size x # of Files | Average Time per File | Total Time | Throughput |
|---|---|---|---|---|
Inbound File Type – EDI 4010 Orders Mapping – Medium Complex # of ST = 1 | 2KB x 3000 | 5s | 12m | 4 files/sec |
Inbound File Type – EDI 4010 Orders Mapping – Medium Complex # of ST = 1 | 2KB x 6000 | 5s | 23m | 4 files/sec
|
Inbound File Type – EDI 4010 Orders Mapping – Medium Complex # of ST = 1 | 2KB x 20,000 | 6s | 1h 23m | 4 files/sec
|
Inbound File Type – EDI 4010 Orders Mapping – Medium Complex # of ST = 44 | 37KB x 1000 | 2m | 1h 12m | 4 files/sec
|
Outbound EDI from IDOC File Type – EDI 4010 Invoice Mapping – Medium Complex | 14KB x 3000 | 3s | 10m | 5 files/sec
|
Test B - Large Sized EDI Files
System Configuration
- Single node (no cluster)
- Processor = Intel Xeon CPU E5-2686 2.30GHz
- Number Of Cores = 4
- Total RAM = 15GB
- OS = Windows Server 2012 R2 64-bit
- Backend / Log Database - AWS Oracle RDS
- Kernel = 8GB
Result: All tests ran successfully
Scenario | File Size x # of Files | Max CPU % | Max RAM % | Max. Kernel Heap | Total Time |
|---|---|---|---|---|---|
Inbound File Type – EDI 4010 ISA : 1 GS : 1 Transaction Set : 5000 ~ 25-35 segments in each transaction set
| 2.79MB x 1 | 42% | 38% | 1.1GB | 2m 34s |
Inbound File Type – EDI 4010 ISA : 1 GS : 13 Transaction Set : 1 ST in each GS ~ 140000 segments in each transaction set
| 40.1MB x 1 | 88% | 46% | 2.3GB | 11m 3s |
Inbound File Type – EDI 4010 ISA : 1 GS : 1 Transaction Set : 10000 ~ 50-103 segments in each Transaction set
| 13.6MB x 1 | 72% | 43% | 2.2GB | 5m 16s |
Test C - Large File Processing with Large Data Ingestion
System Configuration
- Single node (no cluster)
- Processor = Intel Xeon CPU E5-2686 2.30GHz
- Number Of Cores = 4
- Total RAM = 15GB
- OS = Windows Server 2012 R2 64-bit
- Backend / Log Database - AWS Oracle RDS
- Kernel = 8GB
Result: All test ran successfully
Scenario | File Size x # of Files | Number of Records per file | Max CPU % | Max RAM % | Time |
|---|---|---|---|---|---|
File Type – XML Mapping – Simple 1-to-1 # of Files = 1
| 25GB x 1 | 696895 | 27% | 34% | 23m 48s |
50GB x 1 | 1393690 | 27% | 34% | 47m 30s | |
200GB x 1 | 5574760 | 27% | 34% | 3h 10m | |
500GB x 1 | 13936900 | 27% | 34% | 7h 52m | |
File Type – XML Mapping – Simple 1-to-1 # of Files = 50 parallel | 25GB x 50 | 696895 | 100% | 37% | 10h 7m (total) 8h 51m (avg/file) |
50GB x 50 | 1393690 | 100% | 37% | 19h 45m (total) 17h 13m (avg/file) | |
File Type – XML Mapping – Complex (Functions used: Math, String, DB Look, If Condition) # of Files = 1 | 25GB x 1 | 696895 | 29% | 36% | 33m 30s |
50GB x 1 | 1393690 | 29% | 36% | 1h 7m | |
200GB x 1 | 5574760 | 29% | 36% | 4h 27m | |
500GB x 1 | 13936900 | 29% | 36% | 11h 13m | |
File Type – XML Mapping – Complex # of Files = 50 parallel | 25GB x 50 | 696895 | 100% | 39% | 9h 59m (total) 8h 22m (avg/file) |
50GB x 50 | 1393690 | 100% | 39% | 20h 2m (total) 15h 53m (avg/file) | |
File Type – TEXT Mapping – Simple 1-to-1 # of Files = 1 | 25GB x 1 | 696895 | 45% | 36% | 6h 26m |
50GB x 1 | 1393690 | 45% | 36% | 12h 40m | |
200GB x 1 | 5574760 | 45% | 36% | 51h 30m |
Test D - UI Load Testing with Concurrent Users
System Configuration
- Single node (no cluster)
- Processor = Intel Xeon CPU E5-2686 2.30GHz
- Number Of Cores = 4
- Total RAM = 15GB
- OS = Linux 64-bit
- Backend / Log Database - AWS Oracle RDS
- Kernel = 8GB
- Tool used = JMeter
Result: All tests ran successfully
Scenario | Home Page | Dashboard | Network | Partners | Transactions | Max CPU % | Max RAM % |
|---|---|---|---|---|---|---|---|
# of Partners and Transactions in Back-end DB = 1138 # of Concurrent Users = 25 # of Loops (iterations) = 50
| 4.2s | 1.1s | 0.8s | 0.4s | 0.6s | 53% | 64% |
# of Partners and Transactions in Back-end DB = 1638 # of Concurrent Users = 25 # of Loops (iterations) = 50
| 4.3s | 1.0s | 0.9s | 0.3s | 0.4s | 49% | 59% |
# of Partners and Transactions in Back-end DB = 2200 # of Concurrent Users = 25 # of Loops (iterations) = 50
| 4.3s | 1.2s | 1s | 0.3s | 0.5s | 36% | 60% |