Overview

Total
Summary
client1
client2
client3
client4
client5


Sheet 1: Total

ION SR-71mach5+
(8) Intel 750 400GB SSDs in (2) RAID 5 array of (4) NVMe SSDs each
(16) Intel DC S3610 1600GB SSDs in (2) RAID 5 array of (8) SATA SSDs each
Each Array has (5) Partitions; All Partitions on each array are xfs
SR-71mach5+ has (10) 10Gb Etherent ports with 9014 byte frames
(5) clients each have (2) 10Gb Ethernet ports with 9014 byte frames
(5) clients each have NFS4 mount of one partition on each RAID array









SATA SATA NVMe NVMe Total Total ms
Test Jobs I/Os Jobs I/Os IOPS MBPS Ave Lat
8kB Random Write 1 1 1 2 81,155 640 0.36
64kB Random Write 1 1 4 2 19,980 1,268 6.73
8kB Random Read/Write 4 8 4 8 162,091 860 5.68
64kB Random Read/Write 5 4 5 2 34,091 1,454 11.18
1MB Sequential Write 1 2 1 8 4,460 4,567 32.66
1MB Sequential Read 1 8 1 2 10,673 10,928 8.44
256kB Sequential Write 1 8 1 1 19,340 4,945 3.79
256kB Sequential Read 1 8 1 4 43,524 11,134 2.71
64kB Sequential Write 1 4 1 4 80,260 5,129 1.35
64kB Sequential Read 1 10 1 8 164,926 10,546 1.12
64kB Random Read 2 2 4 2 118,630 7,585 1.03
64kB Random Read 6 4 4 8 152,795 9,769 3.68
32kB Random Read 5 2 3 4 233,584 7,464 0.95
32kB Random Read 4 16 3 8 272,820 8,719 3.06
16kB Random Read 5 16 4 4 346,928 5,542 2.64
8kB Random Read 6 2 4 2 335,746 2,677 0.59
8kB Random Read 4 8 4 4 368,508 2,938 1.29
4kB Random Read 4 2 4 2 320,872 1,274 0.50
4kB Random Read 5 16 4 4 374,869 1,489 2.48

Sheet 2: Summary

ION SR-71mach5+
(8) Intel 750 400GB SSDs in (2) RAID 5 array of (4) NVMe SSDs each
(16) Intel DC S3610 1600GB SSDs in (2) RAID 5 array of (8) SATA SSDs each
Each Array has (5) Partitions; All Partitions on each array are xfs
SR-71mach5+ has (10) 10Gb Etherent ports with 9014 byte frames
(5) clients each have (2) 10Gb Ethernet ports with 9014 byte frames
(5) clients each have NFS4 mout of one partition on each RAID array
 

SATA SATA NVMe NVMe
Total

Client 1

Client 2

Client 3

Client 4

Client 5
Test Jobs I/Os Jobs I/Os IOPS MBPS Ave Lat IOPS MBPS Ave Lat IOPS MBPS Ave Lat IOPS MBPS Ave Lat IOPS MBPS Ave Lat IOPS MBPS Ave Lat
8kB Random Write 1 1 1 2 81,155 640 362 16,219 128 363 16,172 128 364 16,224 128 362 16,299 128 361 16,241 128 362
64kB Random Write 1 1 4 2 19,980 1,268 6,733 3,876 246 6,801 3,872 246 6,794 3,939 250 6,750 4,178 265 6,674 4,115 261 6,648
8kB Random Read/Write 4 8 4 8 162,091 860 5,676 32,922 175 5,571 32,633 173 5,626 32,532 172 5,647 32,337 172 5,710 31,667 168 5,828
64kB Random Read/Write 5 4 5 2 34,091 1,454 11,180 6,856 293 11,098 6,822 291 11,147 6,816 291 11,189 6,807 290 11,207 6,790 289 11,260
1MB Sequential Write 1 2 1 8 4,460 4,567 32,662 851 871 33,490 844 864 33,815 920 941 32,105 921 944 31,900 924 947 32,000
1MB Sequential Read 1 8 1 2 10,673 10,928 8,436 2,208 2,261 8,142 2,206 2,258 8,152 2,084 2,134 8,635 2,020 2,068 8,907 2,155 2,207 8,345
256kB Sequential Write 1 8 1 1 19,340 4,945 3,785 3,971 1,016 3,685 3,936 1,006 3,719 3,783 968 3,868 3,813 974 3,839 3,837 981 3,815
256kB Sequential Read 1 8 1 4 43,524 11,134 2,708 9,083 2,325 2,597 9,057 2,316 2,604 8,541 2,184 2,753 8,213 2,101 2,863 8,630 2,208 2,723
64kB Sequential Write 1 4 1 4 80,260 5,129 1,353 15,492 990 1,401 15,532 993 1,397 16,137 1,030 1,335 16,425 1,050 1,330 16,674 1,066 1,302
64kB Sequential Read 1 10 1 8 164,926 10,546 1,122 32,950 2,107 1,124 33,025 2,111 1,119 32,813 2,098 1,126 31,957 2,044 1,155 34,181 2,186 1,085
64kB Random Read 2 2 4 2 118,630 7,585 1,028 23,335 1,492 1,045 23,380 1,495 1,042 23,387 1,495 1,045 23,956 1,532 1,013 24,572 1,571 994
64kB Random Read 6 4 4 8 152,795 9,769 3,677 31,285 2,000 3,587 31,595 2,020 3,552 30,508 1,951 3,678 28,216 1,804 3,974 31,191 1,994 3,595
32kB Random Read 5 2 3 4 233,584 7,464 950 46,135 1,475 961 46,078 1,472 963 46,130 1,474 963 46,675 1,492 950 48,566 1,551 915
32kB Random Read 4 16 3 8 272,820 8,719 3,063 54,393 1,738 3,068 54,663 1,746 3,053 55,293 1,768 3,018 51,152 1,635 3,265 57,319 1,832 2,909
16kB Random Read 5 16 4 4 346,928 5,542 2,637 69,338 1,108 2,638 69,387 1,108 2,637 69,395 1,108 2,635 69,344 1,108 2,632 69,464 1,110 2,642
8kB Random Read 6 2 4 2 335,746 2,677 589 66,291 527 596 66,522 531 594 66,866 533 591 67,258 537 588 68,809 549 575
8kB Random Read 4 8 4 4 368,508 2,938 1,285 73,667 587 1,286 73,704 588 1,285 73,677 587 1,286 73,632 587 1,284 73,828 589 1,285
4kB Random Read 4 2 4 2 320,872 1,274 498 63,532 252 503 63,700 254 501 64,053 254 499 64,378 256 496 65,209 258 490
4kB Random Read 5 16 4 4 374,869 1,489 2,483 74,966 298 2,483 75,002 298 2,484 74,938 297 2,484 74,895 297 2,480 75,068 299 2,486

Sheet 3: client1

client1 8k-randwrite S1J-1Q SATA0 2937 23 338
client1 8k-randwrite S1J-1Q SATA1 2803 22 355
client1 8k-randwrite NVMe0 N1J-1Q 5072 40 392
client1 8k-randwrite NVMe1 N1J-1Q 5407 43 367
client1 8k-randwrite S1J-1Q N1J-2Q 16219 128 363
client1 64k-randwrite S1J-1Q SATA0 1240 79 800
client1 64k-randwrite S1J-1Q SATA1 1389 88 716
client1 64k-randwrite NVMe0 N1J-1Q 599 38 13351
client1 64k-randwrite NVMe1 N1J-1Q 648 41 12339
client1 64k-randwrite S1J-1Q N4J-2Q 3876 246 6801
client1 8k-randrw S4J-8Q SATA0 6053 32 7031
client1 8k-randrw S4J-8Q SATA1 5863 31 7297
client1 8k-randrw NVMe0 N4J-8Q 10271 55 4071
client1 8k-randrw NVMe1 N4J-8Q 10735 57 3887
client1 8k-randrw S4J-8Q N4J-8Q 32922 175 5571
client1 64k-randrw S5J-4Q SATA0 1862 79 14536
client1 64k-randrw S5J-4Q SATA1 1823 78 14807
client1 64k-randrw NVMe0 N5J-4Q 1539 66 7754
client1 64k-randrw NVMe1 N5J-4Q 1632 70 7296
client1 64k-randrw S5J-4Q N5J-2Q 6856 293 11098
client1 1m-write S1J-2Q SATA0 302 309 6610
client1 1m-write S1J-2Q SATA1 284 291 7020
client1 1m-write NVMe0 N1J-2Q 134 137 59630
client1 1m-write NVMe1 N1J-2Q 131 134 60700
client1 1m-write S1J-2Q N1J-8Q 851 871 33490
client1 1m-read S1J-8Q SATA0 745 763 10730
client1 1m-read S1J-8Q SATA1 743 761 10750
client1 1m-read NVMe0 N1J-8Q 360 369 5540
client1 1m-read NVMe1 N1J-8Q 360 368 5550
client1 1m-read S1J-8Q N1J-2Q 2208 2261 8142
client1 256k-write S1J-8Q SATA0 1485 380 5382
client1 256k-write S1J-8Q SATA1 1470 376 5437
client1 256k-write NVMe0 N1J-8Q 511 131 1948
client1 256k-write NVMe1 N1J-8Q 505 129 1973
client1 256k-write S1J-8Q N1J-1Q 3971 1016 3685
client1 256k-read S1J-8Q SATA0 2390 612 3343
client1 256k-read S1J-8Q SATA1 2406 616 3322
client1 256k-read NVMe0 N1J-8Q 2154 551 1853
client1 256k-read NVMe1 N1J-8Q 2133 546 1872
client1 256k-read S1J-8Q N1J-4Q 9083 2325 2597
client1 64k-write S1J-4Q SATA0 5566 356 717
client1 64k-write S1J-4Q SATA1 6159 394 647
client1 64k-write NVMe0 N1J-4Q 1916 122 2085
client1 64k-write NVMe1 N1J-4Q 1851 118 2158
client1 64k-write S1J-4Q N1J-4Q 15492 990 1401
client1 64k-read S1J-10Q SATA0 7222 462 1383
client1 64k-read S1J-10Q SATA1 7182 459 1391
client1 64k-read NVMe0 N1J-10Q 9278 593 861
client1 64k-read NVMe1 N1J-10Q 9268 593 862
client1 64k-read S1J-10Q N1J-8Q 32950 2107 1124
client1 64k-randread S2J-2Q SATA0 3662 234 1089
client1 64k-randread S2J-2Q SATA1 3686 235 1081
client1 64k-randread NVMe0 N2J-2Q 8706 557 916
client1 64k-randread NVMe1 N2J-2Q 7281 466 1095
client1 64k-randread S2J-2Q N4J-2Q 23335 1492 1045
client1 64k-randread S6J-4Q SATA0 6443 412 3721
client1 64k-randread S6J-4Q SATA1 7521 481 3188
client1 64k-randread NVMe0 N6J-4Q 9420 602 3394
client1 64k-randread NVMe1 N6J-4Q 7901 505 4047
client1 64k-randread S6J-4Q N4J-8Q 31285 2000 3587
client1 32k-randread S5J-2Q SATA0 9546 305 1045
client1 32k-randread S5J-2Q SATA1 9925 317 1005
client1 32k-randread NVMe0 N5J-2Q 13627 436 878
client1 32k-randread NVMe1 N5J-2Q 13037 417 918
client1 32k-randread S5J-2Q N3J-4Q 46135 1475 961
client1 32k-randread S4J-16Q SATA0 17704 566 3613
client1 32k-randread S4J-16Q SATA1 17646 564 3625
client1 32k-randread NVMe0 N4J-16Q 9588 306 2501
client1 32k-randread NVMe1 N4J-16Q 9455 302 2536
client1 32k-randread S4J-16Q N3J-8Q 54393 1738 3068
client1 16k-randread S5J-16Q SATA0 28253 452 2829
client1 16k-randread S5J-16Q SATA1 27944 447 2861
client1 16k-randread NVMe0 N5J-16Q 6519 104 2452
client1 16k-randread NVMe1 N5J-16Q 6622 105 2413
client1 16k-randread S5J-16Q N4J-4Q 69338 1108 2638
client1 8k-randread S6J-2Q SATA0 18855 150 634
client1 8k-randread S6J-2Q SATA1 19351 154 618
client1 8k-randread NVMe0 N6J-2Q 13869 110 574
client1 8k-randread NVMe1 N6J-2Q 14216 113 560
client1 8k-randread S6J-2Q N4J-2Q 66291 527 596
client1 8k-randread S4J-8Q SATA0 23998 191 1331
client1 8k-randread S4J-8Q SATA1 23882 191 1338
client1 8k-randread NVMe0 N4J-8Q 12957 103 1233
client1 8k-randread NVMe1 N4J-8Q 12830 102 1244
client1 8k-randread S4J-8Q N4J-4Q 73667 587 1286
client1 4k-randread S4J-2Q SATA0 14828 59 537
client1 4k-randread S4J-2Q SATA1 15183 60 525
client1 4k-randread NVMe0 N4J-2Q 16554 66 481
client1 4k-randread NVMe1 N4J-2Q 16967 67 469
client1 4k-randread S4J-2Q N4J-2Q 63532 252 503
client1 4k-randread S5J-16Q SATA0 30872 123 2589
client1 4k-randread S5J-16Q SATA1 30580 122 2614
client1 4k-randread NVMe0 N5J-16Q 6689 26 2389
client1 4k-randread NVMe1 N5J-16Q 6825 27 2342
client1 4k-randread S5J-16Q N4J-4Q 74966 298 2483

Sheet 4: client2

client2 8k-randwrite S1J-1Q SATA0 2922 23 340
client2 8k-randwrite S1J-1Q SATA1 2751 22 361
client2 8k-randwrite NVMe0 N1J-1Q 5064 40 393
client2 8k-randwrite NVMe1 N1J-1Q 5435 43 365
client2 8k-randwrite S1J-1Q N1J-2Q 16172 128 364
client2 64k-randwrite S1J-1Q SATA0 1233 78 805
client2 64k-randwrite S1J-1Q SATA1 1390 89 716
client2 64k-randwrite NVMe0 N1J-1Q 597 38 13395
client2 64k-randwrite NVMe1 N1J-1Q 652 41 12260
client2 64k-randwrite S1J-1Q N4J-2Q 3872 246 6794
client2 8k-randrw S4J-8Q SATA0 6017 32 7081
client2 8k-randrw S4J-8Q SATA1 5822 31 7363
client2 8k-randrw NVMe0 N4J-8Q 10247 54 4079
client2 8k-randrw NVMe1 N4J-8Q 10547 56 3983
client2 8k-randrw S4J-8Q N4J-8Q 32633 173 5626
client2 64k-randrw S5J-4Q SATA0 1848 79 14642
client2 64k-randrw S5J-4Q SATA1 1820 78 14824
client2 64k-randrw NVMe0 N5J-4Q 1532 65 7780
client2 64k-randrw NVMe1 N5J-4Q 1622 69 7344
client2 64k-randrw S5J-4Q N5J-2Q 6822 291 11147
client2 1m-write S1J-2Q SATA0 301 308 6630
client2 1m-write S1J-2Q SATA1 280 287 7120
client2 1m-write NVMe0 N1J-2Q 133 136 60040
client2 1m-write NVMe1 N1J-2Q 130 133 61470
client2 1m-write S1J-2Q N1J-8Q 844 864 33815
client2 1m-read S1J-8Q SATA0 738 755 10840
client2 1m-read S1J-8Q SATA1 739 757 10810
client2 1m-read NVMe0 N1J-8Q 372 381 5370
client2 1m-read NVMe1 N1J-8Q 357 365 5590
client2 1m-read S1J-8Q N1J-2Q 2206 2258 8152
client2 256k-write S1J-8Q SATA0 1478 378 5407
client2 256k-write S1J-8Q SATA1 1448 370 5522
client2 256k-write NVMe0 N1J-8Q 512 131 1946
client2 256k-write NVMe1 N1J-8Q 498 127 2002
client2 256k-write S1J-8Q N1J-1Q 3936 1006 3719
client2 256k-read S1J-8Q SATA0 2393 612 3340
client2 256k-read S1J-8Q SATA1 2396 613 3336
client2 256k-read NVMe0 N1J-8Q 2140 547 1866
client2 256k-read NVMe1 N1J-8Q 2128 544 1876
client2 256k-read S1J-8Q N1J-4Q 9057 2316 2604
client2 64k-write S1J-4Q SATA0 5394 345 739
client2 64k-write S1J-4Q SATA1 6353 406 628
client2 64k-write NVMe0 N1J-4Q 1906 122 2096
client2 64k-write NVMe1 N1J-4Q 1879 120 2126
client2 64k-write S1J-4Q N1J-4Q 15532 993 1397
client2 64k-read S1J-10Q SATA0 7259 464 1376
client2 64k-read S1J-10Q SATA1 7279 465 1372
client2 64k-read NVMe0 N1J-10Q 9307 595 858
client2 64k-read NVMe1 N1J-10Q 9180 587 870
client2 64k-read S1J-10Q N1J-8Q 33025 2111 1119
client2 64k-randread S2J-2Q SATA0 3680 235 1084
client2 64k-randread S2J-2Q SATA1 3707 237 1076
client2 64k-randread NVMe0 N2J-2Q 8640 553 923
client2 64k-randread NVMe1 N2J-2Q 7353 470 1085
client2 64k-randread S2J-2Q N4J-2Q 23380 1495 1042
client2 64k-randread S6J-4Q SATA0 6556 419 3658
client2 64k-randread S6J-4Q SATA1 7669 490 3126
client2 64k-randread NVMe0 N6J-4Q 9473 606 3375
client2 64k-randread NVMe1 N6J-4Q 7897 505 4049
client2 64k-randread S6J-4Q N4J-8Q 31595 2020 3552
client2 32k-randread S5J-2Q SATA0 9515 304 1048
client2 32k-randread S5J-2Q SATA1 9926 317 1005
client2 32k-randread NVMe0 N5J-2Q 13670 437 876
client2 32k-randread NVMe1 N5J-2Q 12967 414 923
client2 32k-randread S5J-2Q N3J-4Q 46078 1472 963
client2 32k-randread S4J-16Q SATA0 17777 568 3598
client2 32k-randread S4J-16Q SATA1 17747 567 3604
client2 32k-randread NVMe0 N4J-16Q 9656 308 2483
client2 32k-randread NVMe1 N4J-16Q 9483 303 2528
client2 32k-randread S4J-16Q N3J-8Q 54663 1746 3053
client2 16k-randread S5J-16Q SATA0 28268 452 2828
client2 16k-randread S5J-16Q SATA1 27978 447 2857
client2 16k-randread NVMe0 N5J-16Q 6491 103 2462
client2 16k-randread NVMe1 N5J-16Q 6650 106 2404
client2 16k-randread S5J-16Q N4J-4Q 69387 1108 2637
client2 8k-randread S6J-2Q SATA0 19396 155 616
client2 8k-randread S6J-2Q SATA1 18937 151 631
client2 8k-randread NVMe0 N6J-2Q 14300 114 557
client2 8k-randread NVMe1 N6J-2Q 13889 111 573
client2 8k-randread S6J-2Q N4J-2Q 66522 531 594
client2 8k-randread S4J-8Q SATA0 24012 192 1330
client2 8k-randread S4J-8Q SATA1 23900 191 1337
client2 8k-randread NVMe0 N4J-8Q 12873 102 1240
client2 8k-randread NVMe1 N4J-8Q 12919 103 1236
client2 8k-randread S4J-8Q N4J-4Q 73704 588 1285
client2 4k-randread S4J-2Q SATA0 15277 61 521
client2 4k-randread S4J-2Q SATA1 14796 59 538
client2 4k-randread NVMe0 N4J-2Q 17054 68 467
client2 4k-randread NVMe1 N4J-2Q 16573 66 480
client2 4k-randread S4J-2Q N4J-2Q 63700 254 501
client2 4k-randread S5J-16Q SATA0 30866 123 2590
client2 4k-randread S5J-16Q SATA1 30635 122 2610
client2 4k-randread NVMe0 N5J-16Q 6671 26 2396
client2 4k-randread NVMe1 N5J-16Q 6830 27 2340
client2 4k-randread S5J-16Q N4J-4Q 75002 298 2484

Sheet 5: client3

client3 8k-randwrite S1J-1Q SATA0 2933 23 336
client3 8k-randwrite S1J-1Q SATA1 2758 22 357
client3 8k-randwrite NVMe0 N1J-1Q 5071 40 393
client3 8k-randwrite NVMe1 N1J-1Q 5462 43 364
client3 8k-randwrite S1J-1Q N1J-2Q 16224 128 362
client3 64k-randwrite S1J-1Q SATA0 1276 81 778
client3 64k-randwrite S1J-1Q SATA1 1409 90 706
client3 64k-randwrite NVMe0 N1J-1Q 603 38 13244
client3 64k-randwrite NVMe1 N1J-1Q 651 41 12272
client3 64k-randwrite S1J-1Q N4J-2Q 3939 250 6750
client3 8k-randrw S4J-8Q SATA0 5963 31 7163
client3 8k-randrw S4J-8Q SATA1 5846 31 7317
client3 8k-randrw NVMe0 N4J-8Q 10027 53 4200
client3 8k-randrw NVMe1 N4J-8Q 10696 57 3909
client3 8k-randrw S4J-8Q N4J-8Q 32532 172 5647
client3 64k-randrw S5J-4Q SATA0 1851 79 14604
client3 64k-randrw S5J-4Q SATA1 1795 77 15072
client3 64k-randrw NVMe0 N5J-4Q 1533 65 7790
client3 64k-randrw NVMe1 N5J-4Q 1637 70 7293
client3 64k-randrw S5J-4Q N5J-2Q 6816 291 11189
client3 1m-write S1J-2Q SATA0 336 344 5940
client3 1m-write S1J-2Q SATA1 309 316 6460
client3 1m-write NVMe0 N1J-2Q 139 142 57470
client3 1m-write NVMe1 N1J-2Q 136 139 58550
client3 1m-write S1J-2Q N1J-8Q 920 941 32105
client3 1m-read S1J-8Q SATA0 707 724 11310
client3 1m-read S1J-8Q SATA1 707 724 11310
client3 1m-read NVMe0 N1J-8Q 331 339 6030
client3 1m-read NVMe1 N1J-8Q 339 347 5890
client3 1m-read S1J-8Q N1J-2Q 2084 2134 8635
client3 256k-write S1J-8Q SATA0 1422 364 5623
client3 256k-write S1J-8Q SATA1 1395 357 5731
client3 256k-write NVMe0 N1J-8Q 485 124 2052
client3 256k-write NVMe1 N1J-8Q 481 123 2069
client3 256k-write S1J-8Q N1J-1Q 3783 968 3868
client3 256k-read S1J-8Q SATA0 2285 584 3498
client3 256k-read S1J-8Q SATA1 2296 587 3481
client3 256k-read NVMe0 N1J-8Q 1989 509 2008
client3 256k-read NVMe1 N1J-8Q 1971 504 2026
client3 256k-read S1J-8Q N1J-4Q 8541 2184 2753
client3 64k-write S1J-4Q SATA0 6041 386 660
client3 64k-write S1J-4Q SATA1 6130 392 650
client3 64k-write NVMe0 N1J-4Q 2029 129 1969
client3 64k-write NVMe1 N1J-4Q 1937 123 2062
client3 64k-write S1J-4Q N1J-4Q 16137 1030 1335
client3 64k-read S1J-10Q SATA0 7189 460 1389
client3 64k-read S1J-10Q SATA1 7242 463 1379
client3 64k-read NVMe0 N1J-10Q 9196 588 868
client3 64k-read NVMe1 N1J-10Q 9186 587 869
client3 64k-read S1J-10Q N1J-8Q 32813 2098 1126
client3 64k-randread S2J-2Q SATA0 3556 227 1121
client3 64k-randread S2J-2Q SATA1 3735 239 1068
client3 64k-randread NVMe0 N2J-2Q 8671 554 920
client3 64k-randread NVMe1 N2J-2Q 7425 475 1074
client3 64k-randread S2J-2Q N4J-2Q 23387 1495 1045
client3 64k-randread S6J-4Q SATA0 6288 402 3814
client3 64k-randread S6J-4Q SATA1 7380 472 3249
client3 64k-randread NVMe0 N6J-4Q 9128 584 3503
client3 64k-randread NVMe1 N6J-4Q 7712 493 4146
client3 64k-randread S6J-4Q N4J-8Q 30508 1951 3678
client3 32k-randread S5J-2Q SATA0 9495 303 1050
client3 32k-randread S5J-2Q SATA1 9841 314 1014
client3 32k-randread NVMe0 N5J-2Q 13689 438 874
client3 32k-randread NVMe1 N5J-2Q 13105 419 914
client3 32k-randread S5J-2Q N3J-4Q 46130 1474 963
client3 32k-randread S4J-16Q SATA0 17883 572 3577
client3 32k-randread S4J-16Q SATA1 18011 576 3551
client3 32k-randread NVMe0 N4J-16Q 9728 311 2465
client3 32k-randread NVMe1 N4J-16Q 9671 309 2479
client3 32k-randread S4J-16Q N3J-8Q 55293 1768 3018
client3 16k-randread S5J-16Q SATA0 28139 450 2841
client3 16k-randread S5J-16Q SATA1 28087 449 2846
client3 16k-randread NVMe0 N5J-16Q 6483 103 2465
client3 16k-randread NVMe1 N5J-16Q 6686 106 2390
client3 16k-randread S5J-16Q N4J-4Q 69395 1108 2635
client3 8k-randread S6J-2Q SATA0 19473 155 614
client3 8k-randread S6J-2Q SATA1 19043 152 628
client3 8k-randread NVMe0 N6J-2Q 14380 115 554
client3 8k-randread NVMe1 N6J-2Q 13970 111 570
client3 8k-randread S6J-2Q N4J-2Q 66866 533 591
client3 8k-randread S4J-8Q SATA0 23919 191 1336
client3 8k-randread S4J-8Q SATA1 23970 191 1333
client3 8k-randread NVMe0 N4J-8Q 12822 102 1245
client3 8k-randread NVMe1 N4J-8Q 12966 103 1232
client3 8k-randread S4J-8Q N4J-4Q 73677 587 1286
client3 4k-randread S4J-2Q SATA0 14946 59 533
client3 4k-randread S4J-2Q SATA1 15293 61 521
client3 4k-randread NVMe0 N4J-2Q 16683 66 477
client3 4k-randread NVMe1 N4J-2Q 17131 68 465
client3 4k-randread S4J-2Q N4J-2Q 64053 254 499
client3 4k-randread S5J-16Q SATA0 30735 122 2601
client3 4k-randread S5J-16Q SATA1 30690 122 2605
client3 4k-randread NVMe0 N5J-16Q 6686 26 2391
client3 4k-randread NVMe1 N5J-16Q 6827 27 2341
client3 4k-randread S5J-16Q N4J-4Q 74938 297 2484

Sheet 6: client4

client4 8k-randwrite S1J-1Q SATA0 2961 23 333
client4 8k-randwrite S1J-1Q SATA1 2765 22 357
client4 8k-randwrite NVMe0 N1J-1Q 5096 40 391
client4 8k-randwrite NVMe1 N1J-1Q 5477 43 363
client4 8k-randwrite S1J-1Q N1J-2Q 16299 128 361
client4 64k-randwrite S1J-1Q SATA0 1497 95 663
client4 64k-randwrite S1J-1Q SATA1 1417 90 701
client4 64k-randwrite NVMe0 N1J-1Q 608 38 13151
client4 64k-randwrite NVMe1 N1J-1Q 656 42 12183
client4 64k-randwrite S1J-1Q N4J-2Q 4178 265 6674
client4 8k-randrw S4J-8Q SATA0 5901 31 7274
client4 8k-randrw S4J-8Q SATA1 5798 31 7403
client4 8k-randrw NVMe0 N4J-8Q 9987 53 4226
client4 8k-randrw NVMe1 N4J-8Q 10651 57 3937
client4 8k-randrw S4J-8Q N4J-8Q 32337 172 5710
client4 64k-randrw S5J-4Q SATA0 1862 79 14499
client4 64k-randrw S5J-4Q SATA1 1795 77 15093
client4 64k-randrw NVMe0 N5J-4Q 1522 65 7860
client4 64k-randrw NVMe1 N5J-4Q 1628 69 7376
client4 64k-randrw S5J-4Q N5J-2Q 6807 290 11207
client4 1m-write S1J-2Q SATA0 336 344 5940
client4 1m-write S1J-2Q SATA1 308 316 6470
client4 1m-write NVMe0 N1J-2Q 140 143 57100
client4 1m-write NVMe1 N1J-2Q 137 141 58090
client4 1m-write S1J-2Q N1J-8Q 921 944 31900
client4 1m-read S1J-8Q SATA0 690 706 11580
client4 1m-read S1J-8Q SATA1 689 706 11590
client4 1m-read NVMe0 N1J-8Q 321 328 6220
client4 1m-read NVMe1 N1J-8Q 320 328 6240
client4 1m-read S1J-8Q N1J-2Q 2020 2068 8907
client4 256k-write S1J-8Q SATA0 1427 365 5600
client4 256k-write S1J-8Q SATA1 1401 358 5706
client4 256k-write NVMe0 N1J-8Q 490 125 2034
client4 256k-write NVMe1 N1J-8Q 495 126 2016
client4 256k-write S1J-8Q N1J-1Q 3813 974 3839
client4 256k-read S1J-8Q SATA0 2201 563 3631
client4 256k-read S1J-8Q SATA1 2199 562 3635
client4 256k-read NVMe0 N1J-8Q 1914 490 2086
client4 256k-read NVMe1 N1J-8Q 1899 486 2103
client4 256k-read S1J-8Q N1J-4Q 8213 2101 2863
client4 64k-write S1J-4Q SATA0 6100 390 654
client4 64k-write S1J-4Q SATA1 6371 407 626
client4 64k-write NVMe0 N1J-4Q 2016 129 1982
client4 64k-write NVMe1 N1J-4Q 1938 124 2061
client4 64k-write S1J-4Q N1J-4Q 16425 1050 1330
client4 64k-read S1J-10Q SATA0 7078 453 1411
client4 64k-read S1J-10Q SATA1 7032 450 1420
client4 64k-read NVMe0 N1J-10Q 8992 575 888
client4 64k-read NVMe1 N1J-10Q 8855 566 902
client4 64k-read S1J-10Q N1J-8Q 31957 2044 1155
client4 64k-randread S2J-2Q SATA0 3714 237 1074
client4 64k-randread S2J-2Q SATA1 3937 252 1013
client4 64k-randread NVMe0 N2J-2Q 8704 557 916
client4 64k-randread NVMe1 N2J-2Q 7601 486 1050
client4 64k-randread S2J-2Q N4J-2Q 23956 1532 1013
client4 64k-randread S6J-4Q SATA0 5915 378 4054
client4 64k-randread S6J-4Q SATA1 6672 427 3594
client4 64k-randread NVMe0 N6J-4Q 8509 544 3758
client4 64k-randread NVMe1 N6J-4Q 7120 455 4491
client4 64k-randread S6J-4Q N4J-8Q 28216 1804 3974
client4 32k-randread S5J-2Q SATA0 9815 314 1016
client4 32k-randread S5J-2Q SATA1 9936 317 1004
client4 32k-randread NVMe0 N5J-2Q 14001 448 855
client4 32k-randread NVMe1 N5J-2Q 12923 413 926
client4 32k-randread S5J-2Q N3J-4Q 46675 1492 950
client4 32k-randread S4J-16Q SATA0 16643 532 3843
client4 32k-randread S4J-16Q SATA1 16725 535 3824
client4 32k-randread NVMe0 N4J-16Q 8904 284 2693
client4 32k-randread NVMe1 N4J-16Q 8880 284 2700
client4 32k-randread S4J-16Q N3J-8Q 51152 1635 3265
client4 16k-randread S5J-16Q SATA0 28104 449 2844
client4 16k-randread S5J-16Q SATA1 28009 448 2854
client4 16k-randread NVMe0 N5J-16Q 6521 104 2451
client4 16k-randread NVMe1 N5J-16Q 6710 107 2382
client4 16k-randread S5J-16Q N4J-4Q 69344 1108 2632
client4 8k-randread S6J-2Q SATA0 19507 156 613
client4 8k-randread S6J-2Q SATA1 19354 154 618
client4 8k-randread NVMe0 N6J-2Q 14250 114 559
client4 8k-randread NVMe1 N6J-2Q 14147 113 563
client4 8k-randread S6J-2Q N4J-2Q 67258 537 588
client4 8k-randread S4J-8Q SATA0 23817 190 1341
client4 8k-randread S4J-8Q SATA1 23813 190 1341
client4 8k-randread NVMe0 N4J-8Q 12928 103 1235
client4 8k-randread NVMe1 N4J-8Q 13074 104 1222
client4 8k-randread S4J-8Q N4J-4Q 73632 587 1284
client4 4k-randread S4J-2Q SATA0 15378 61 518
client4 4k-randread S4J-2Q SATA1 15114 60 527
client4 4k-randread NVMe0 N4J-2Q 17035 68 467
client4 4k-randread NVMe1 N4J-2Q 16851 67 472
client4 4k-randread S4J-2Q N4J-2Q 64378 256 496
client4 4k-randread S5J-16Q SATA0 30680 122 2605
client4 4k-randread S5J-16Q SATA1 30624 122 2610
client4 4k-randread NVMe0 N5J-16Q 6725 26 2377
client4 4k-randread NVMe1 N5J-16Q 6866 27 2328
client4 4k-randread S5J-16Q N4J-4Q 74895 297 2480

Sheet 7: client5

client5 8k-randwrite S1J-1Q SATA0 3008 24 329
client5 8k-randwrite S1J-1Q SATA1 2743 21 361
client5 8k-randwrite NVMe0 N1J-1Q 5048 40 394
client5 8k-randwrite NVMe1 N1J-1Q 5442 43 365
client5 8k-randwrite S1J-1Q N1J-2Q 16241 128 362
client5 64k-randwrite S1J-1Q SATA0 1456 93 683
client5 64k-randwrite S1J-1Q SATA1 1387 88 717
client5 64k-randwrite NVMe0 N1J-1Q 606 38 13186
client5 64k-randwrite NVMe1 N1J-1Q 666 42 12008
client5 64k-randwrite S1J-1Q N4J-2Q 4115 261 6648
client5 8k-randrw S4J-8Q SATA0 5840 31 7358
client5 8k-randrw S4J-8Q SATA1 5730 30 7500
client5 8k-randrw NVMe0 N4J-8Q 9748 52 4366
client5 8k-randrw NVMe1 N4J-8Q 10349 55 4091
client5 8k-randrw S4J-8Q N4J-8Q 31667 168 5828
client5 64k-randrw S5J-4Q SATA0 1848 79 14658
client5 64k-randrw S5J-4Q SATA1 1793 76 15113
client5 64k-randrw NVMe0 N5J-4Q 1523 65 7890
client5 64k-randrw NVMe1 N5J-4Q 1626 69 7382
client5 64k-randrw S5J-4Q N5J-2Q 6790 289 11260
client5 1m-write S1J-2Q SATA0 338 347 5900
client5 1m-write S1J-2Q SATA1 310 318 6430
client5 1m-write NVMe0 N1J-2Q 140 143 57040
client5 1m-write NVMe1 N1J-2Q 136 139 58630
client5 1m-write S1J-2Q N1J-8Q 924 947 32000
client5 1m-read S1J-8Q SATA0 728 745 10990
client5 1m-read S1J-8Q SATA1 729 746 10960
client5 1m-read NVMe0 N1J-8Q 348 357 5730
client5 1m-read NVMe1 N1J-8Q 350 359 5700
client5 1m-read S1J-8Q N1J-2Q 2155 2207 8345
client5 256k-write S1J-8Q SATA0 1430 366 5590
client5 256k-write S1J-8Q SATA1 1407 360 5681
client5 256k-write NVMe0 N1J-8Q 503 128 1983
client5 256k-write NVMe1 N1J-8Q 497 127 2008
client5 256k-write S1J-8Q N1J-1Q 3837 981 3815
client5 256k-read S1J-8Q SATA0 2317 593 3450
client5 256k-read S1J-8Q SATA1 2324 595 3439
client5 256k-read NVMe0 N1J-8Q 1968 503 2028
client5 256k-read NVMe1 N1J-8Q 2021 517 1977
client5 256k-read S1J-8Q N1J-4Q 8630 2208 2723
client5 64k-write S1J-4Q SATA0 6183 395 645
client5 64k-write S1J-4Q SATA1 6438 412 620
client5 64k-write NVMe0 N1J-4Q 2063 132 1937
client5 64k-write NVMe1 N1J-4Q 1990 127 2008
client5 64k-write S1J-4Q N1J-4Q 16674 1066 1302
client5 64k-read S1J-10Q SATA0 7490 479 1334
client5 64k-read S1J-10Q SATA1 7401 473 1350
client5 64k-read NVMe0 N1J-10Q 9727 622 821
client5 64k-read NVMe1 N1J-10Q 9563 612 835
client5 64k-read S1J-10Q N1J-8Q 34181 2186 1085
client5 64k-randread S2J-2Q SATA0 3867 247 1032
client5 64k-randread S2J-2Q SATA1 3841 245 1039
client5 64k-randread NVMe0 N2J-2Q 9176 587 869
client5 64k-randread NVMe1 N2J-2Q 7688 492 1038
client5 64k-randread S2J-2Q N4J-2Q 24572 1571 994
client5 64k-randread S6J-4Q SATA0 6402 409 3745
client5 64k-randread S6J-4Q SATA1 7601 486 3155
client5 64k-randread NVMe0 N6J-4Q 9222 590 3468
client5 64k-randread NVMe1 N6J-4Q 7966 509 4014
client5 64k-randread S6J-4Q N4J-8Q 31191 1994 3595
client5 32k-randread S5J-2Q SATA0 10048 321 993
client5 32k-randread S5J-2Q SATA1 10278 328 971
client5 32k-randread NVMe0 N5J-2Q 14617 467 819
client5 32k-randread NVMe1 N5J-2Q 13623 435 879
client5 32k-randread S5J-2Q N3J-4Q 48566 1551 915
client5 32k-randread S4J-16Q SATA0 18450 590 3467
client5 32k-randread S4J-16Q SATA1 18610 595 3437
client5 32k-randread NVMe0 N4J-16Q 10121 323 2369
client5 32k-randread NVMe1 N4J-16Q 10138 324 2365
client5 32k-randread S4J-16Q N3J-8Q 57319 1832 2909
client5 16k-randread S5J-16Q SATA0 28211 451 2834
client5 16k-randread S5J-16Q SATA1 28197 451 2836
client5 16k-randread NVMe0 N5J-16Q 6419 102 2490
client5 16k-randread NVMe1 N5J-16Q 6637 106 2408
client5 16k-randread S5J-16Q N4J-4Q 69464 1110 2642
client5 8k-randread S6J-2Q SATA0 19751 158 606
client5 8k-randread S6J-2Q SATA1 19886 159 602
client5 8k-randread NVMe0 N6J-2Q 14560 116 548
client5 8k-randread NVMe1 N6J-2Q 14612 116 546
client5 8k-randread S6J-2Q N4J-2Q 68809 549 575
client5 8k-randread S4J-8Q SATA0 23921 191 1336
client5 8k-randread S4J-8Q SATA1 24157 193 1323
client5 8k-randread NVMe0 N4J-8Q 12891 103 1239
client5 8k-randread NVMe1 N4J-8Q 12859 102 1242
client5 8k-randread S4J-8Q N4J-4Q 73828 589 1285
client5 4k-randread S4J-2Q SATA0 15394 61 518
client5 4k-randread S4J-2Q SATA1 15395 61 518
client5 4k-randread NVMe0 N4J-2Q 17194 68 463
client5 4k-randread NVMe1 N4J-2Q 17226 68 463
client5 4k-randread S4J-2Q N4J-2Q 65209 258 490
client5 4k-randread S5J-16Q SATA0 30833 123 2593
client5 4k-randread S5J-16Q SATA1 30791 123 2597
client5 4k-randread NVMe0 N5J-16Q 6648 26 2405
client5 4k-randread NVMe1 N5J-16Q 6796 27 2352
client5 4k-randread S5J-16Q N4J-4Q 75068 299 2486