[2024-07-15 12:50:45.646136] Starting SPDK v24.09-pre git sha1 6151edad3 / DPDK 24.03.0 initialization... [2024-07-15 12:50:45.646310] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1096838 ] Set seed to 1721040645642582 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 12:50:45.781480] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 12:50:46.006567] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 12:50:46.006620] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1096838' to capture a snapshot of events at runtime. [2024-07-15 12:50:46.006638] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 12:50:46.006657] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 12:50:46.006670] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1096838 for offline analysis/debug. [2024-07-15 12:50:46.006793] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 12:50:49 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/15-12:50:56 ... thread 0: (1000000,1000000) ops and (146214.0,146214.0) ops/second in (6.839292,6.839292) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 817.24 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 130.5 6.26 2.48 10 0.626 0 0 0.0 0.0 L1 3/3 126.36 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 100.0 99.6 2.27 1.21 1 2.271 230K 972 0.0 0.0 L2 2/0 99.75 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 124.2 124.2 0.80 0.47 1 0.803 101K 0 0.0 0.0 L3 39/8 2.38 GB 1.7 3.2 2.0 1.2 3.0 1.8 0.0 1.5 105.0 99.5 31.19 16.83 13 2.399 2117K 9985 0.0 0.0 L4 156/21 11.41 GB 1.0 1.7 1.1 0.6 1.7 1.1 0.8 1.4 110.3 105.2 16.07 9.10 10 1.607 180K 0 0.0 0.0 L5 120/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 330/40 24.03 GB 0.0 5.2 3.5 1.8 5.8 4.0 0.8 7.3 94.9 104.9 56.59 30.09 35 1.617 2629K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.2 3.5 1.8 5.8 4.0 0.8 7.3 94.9 104.9 56.59 30.09 35 1.617 2629K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.2 3.5 1.8 5.0 3.2 0.0 0.0 106.8 101.7 50.33 27.61 25 2.013 2629K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 130.5 6.26 2.48 10 0.626 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.9 total, 6.8 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.80 GB write, 860.11 MB/s write, 5.25 GB read, 778.47 MB/s read, 56.6 seconds Interval compaction: 5.80 GB write, 867.70 MB/s write, 5.25 GB read, 785.35 MB/s read, 56.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 23, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 137371 Average: 29.7182 StdDev: 381.99 Min: 1 Median: 2.2611 Max: 51373 Percentiles: P50: 2.26 P75: 3.29 P99: 712.43 P99.9: 4085.90 P99.99: 15392.55 ------------------------------------------------------ [ 0, 1 ] 2368 1.724% 1.724% ( 1, 2 ] 55630 40.496% 42.220% ######## ( 2, 3 ] 40936 29.800% 72.020% ###### ( 3, 4 ] 13888 10.110% 82.129% ## ( 4, 6 ] 16072 11.700% 93.829% ## ( 6, 10 ] 4438 3.231% 97.060% # ( 10, 15 ] 1058 0.770% 97.830% ( 15, 22 ] 152 0.111% 97.941% ( 22, 34 ] 11 0.008% 97.949% ( 34, 51 ] 12 0.009% 97.957% ( 51, 76 ] 9 0.007% 97.964% ( 76, 110 ] 5 0.004% 97.968% ( 110, 170 ] 19 0.014% 97.981% ( 170, 250 ] 100 0.073% 98.054% ( 250, 380 ] 327 0.238% 98.292% ( 380, 580 ] 654 0.476% 98.768% ( 580, 870 ] 697 0.507% 99.276% ( 870, 1300 ] 338 0.246% 99.522% ( 1300, 1900 ] 168 0.122% 99.644% ( 1900, 2900 ] 169 0.123% 99.767% ( 2900, 4400 ] 231 0.168% 99.935% ( 4400, 6600 ] 55 0.040% 99.975% ( 6600, 9900 ] 16 0.012% 99.987% ( 9900, 14000 ] 2 0.001% 99.988% ( 14000, 22000 ] 13 0.009% 99.998% ( 22000, 33000 ] 6 0.004% 100.002% ( 33000, 50000 ] 1 0.001% 100.003% ( 50000, 75000 ] 1 0.001% 100.004% ** Level 1 read latency histogram (micros): Count: 56743 Average: 15.7041 StdDev: 257.32 Min: 1 Median: 2.3722 Max: 39981 Percentiles: P50: 2.37 P75: 3.43 P99: 121.77 P99.9: 3260.50 P99.99: 6958.27 ------------------------------------------------------ [ 0, 1 ] 404 0.712% 0.712% ( 1, 2 ] 21252 37.453% 38.165% ####### ( 2, 3 ] 18044 31.800% 69.965% ###### ( 3, 4 ] 6592 11.617% 81.582% ## ( 4, 6 ] 7574 13.348% 94.930% ### ( 6, 10 ] 1893 3.336% 98.266% # ( 10, 15 ] 366 0.645% 98.911% ( 15, 22 ] 36 0.063% 98.974% ( 22, 34 ] 3 0.005% 98.980% ( 34, 51 ] 5 0.009% 98.988% ( 51, 76 ] 3 0.005% 98.994% ( 76, 110 ] 2 0.004% 98.997% ( 110, 170 ] 8 0.014% 99.011% ( 170, 250 ] 24 0.042% 99.054% ( 250, 380 ] 82 0.145% 99.198% ( 380, 580 ] 148 0.261% 99.459% ( 580, 870 ] 134 0.236% 99.695% ( 870, 1300 ] 44 0.078% 99.773% ( 1300, 1900 ] 26 0.046% 99.818% ( 1900, 2900 ] 34 0.060% 99.878% ( 2900, 4400 ] 51 0.090% 99.968% ( 4400, 6600 ] 12 0.021% 99.989% ( 6600, 9900 ] 3 0.005% 99.995% ( 9900, 14000 ] 1 0.002% 99.996% ( 14000, 22000 ] 1 0.002% 99.998% ( 33000, 50000 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 389407 Average: 16.8267 StdDev: 312.58 Min: 1 Median: 2.3078 Max: 41567 Percentiles: P50: 2.31 P75: 3.34 P99: 13.40 P99.9: 1745.62 P99.99: 2965.82 ------------------------------------------------------ [ 0, 1 ] 3479 0.893% 0.893% ( 1, 2 ] 154669 39.719% 40.613% ######## ( 2, 3 ] 118782 30.503% 71.116% ###### ( 3, 4 ] 44265 11.367% 82.483% ## ( 4, 6 ] 49990 12.837% 95.321% ### ( 6, 10 ] 12237 3.142% 98.463% # ( 10, 15 ] 3072 0.789% 99.252% ( 15, 22 ] 474 0.122% 99.374% ( 22, 34 ] 80 0.021% 99.394% ( 34, 51 ] 97 0.025% 99.419% ( 51, 76 ] 59 0.015% 99.434% ( 76, 110 ] 19 0.005% 99.439% ( 110, 170 ] 22 0.006% 99.445% ( 170, 250 ] 60 0.015% 99.460% ( 250, 380 ] 250 0.064% 99.524% ( 380, 580 ] 521 0.134% 99.658% ( 580, 870 ] 508 0.130% 99.789% ( 870, 1300 ] 265 0.068% 99.857% ( 1300, 1900 ] 227 0.058% 99.915% ( 1900, 2900 ] 276 0.071% 99.986% ( 2900, 4400 ] 366 0.094% 100.080% ( 4400, 6600 ] 120 0.031% 100.111% ( 6600, 9900 ] 46 0.012% 100.122% ( 9900, 14000 ] 10 0.003% 100.125% ( 14000, 22000 ] 19 0.005% 100.130% ( 22000, 33000 ] 15 0.004% 100.134% ( 33000, 50000 ] 5 0.001% 100.135% ** Level 3 read latency histogram (micros): Count: 674183 Average: 19.1770 StdDev: 296.94 Min: 1 Median: 2.3517 Max: 39482 Percentiles: P50: 2.35 P75: 3.36 P99: 14.83 P99.9: 1686.35 P99.99: 2684.37 ------------------------------------------------------ [ 0, 1 ] 4257 0.631% 0.631% ( 1, 2 ] 256509 38.047% 38.679% ######## ( 2, 3 ] 217015 32.189% 70.868% ###### ( 3, 4 ] 76549 11.354% 82.222% ## ( 4, 6 ] 88219 13.085% 95.308% ### ( 6, 10 ] 20431 3.030% 98.338% # ( 10, 15 ] 4615 0.685% 99.023% ( 15, 22 ] 571 0.085% 99.108% ( 22, 34 ] 76 0.011% 99.119% ( 34, 51 ] 168 0.025% 99.144% ( 51, 76 ] 158 0.023% 99.167% ( 76, 110 ] 50 0.007% 99.175% ( 110, 170 ] 65 0.010% 99.184% ( 170, 250 ] 236 0.035% 99.219% ( 250, 380 ] 782 0.116% 99.335% ( 380, 580 ] 1473 0.218% 99.554% ( 580, 870 ] 1351 0.200% 99.754% ( 870, 1300 ] 705 0.105% 99.859% ( 1300, 1900 ] 433 0.064% 99.923% ( 1900, 2900 ] 577 0.086% 100.008% ( 2900, 4400 ] 806 0.120% 100.128% ( 4400, 6600 ] 214 0.032% 100.160% ( 6600, 9900 ] 66 0.010% 100.170% ( 9900, 14000 ] 19 0.003% 100.172% ( 14000, 22000 ] 33 0.005% 100.177% ( 22000, 33000 ] 25 0.004% 100.181% ( 33000, 50000 ] 3 0.000% 100.181% ** Level 4 read latency histogram (micros): Count: 397199 Average: 39.5858 StdDev: 474.33 Min: 1 Median: 2.3853 Max: 71446 Percentiles: P50: 2.39 P75: 3.50 P99: 757.91 P99.9: 3155.82 P99.99: 3658.84 ------------------------------------------------------ [ 0, 1 ] 2400 0.604% 0.604% ( 1, 2 ] 148123 37.292% 37.896% ####### ( 2, 3 ] 124778 31.414% 69.311% ###### ( 3, 4 ] 45546 11.467% 80.777% ## ( 4, 6 ] 51240 12.900% 93.678% ### ( 6, 10 ] 12053 3.034% 96.712% # ( 10, 15 ] 2543 0.640% 97.352% ( 15, 22 ] 282 0.071% 97.423% ( 22, 34 ] 54 0.014% 97.437% ( 34, 51 ] 132 0.033% 97.470% ( 51, 76 ] 120 0.030% 97.500% ( 76, 110 ] 48 0.012% 97.513% ( 110, 170 ] 71 0.018% 97.530% ( 170, 250 ] 384 0.097% 97.627% ( 250, 380 ] 1284 0.323% 97.950% ( 380, 580 ] 2670 0.672% 98.623% ( 580, 870 ] 2445 0.616% 99.238% ( 870, 1300 ] 1158 0.292% 99.530% ( 1300, 1900 ] 614 0.155% 99.684% ( 1900, 2900 ] 676 0.170% 99.854% ( 2900, 4400 ] 1066 0.268% 100.123% ( 4400, 6600 ] 284 0.072% 100.194% ( 6600, 9900 ] 66 0.017% 100.211% ( 9900, 14000 ] 5 0.001% 100.212% ( 14000, 22000 ] 15 0.004% 100.216% ( 22000, 33000 ] 14 0.004% 100.220% ( 33000, 50000 ] 10 0.003% 100.222% ( 50000, 75000 ] 6 0.002% 100.224% ** Level 5 read latency histogram (micros): Count: 7670 Average: 1180.1598 StdDev: 2078.63 Min: 94 Median: 654.8901 Max: 62960 Percentiles: P50: 654.89 P75: 1149.20 P99: 6325.63 P99.9: 36230.00 P99.99: 62960.00 ------------------------------------------------------ ( 76, 110 ] 4 0.052% 0.052% ( 110, 170 ] 48 0.626% 0.678% ( 170, 250 ] 263 3.429% 4.107% # ( 250, 380 ] 938 12.229% 16.336% ## ( 380, 580 ] 2112 27.536% 43.872% ###### ( 580, 870 ] 1820 23.729% 67.601% ##### ( 870, 1300 ] 874 11.395% 78.996% ## ( 1300, 1900 ] 371 4.837% 83.833% # ( 1900, 2900 ] 414 5.398% 89.231% # ( 2900, 4400 ] 597 7.784% 97.014% ## ( 4400, 6600 ] 174 2.269% 99.283% ( 6600, 9900 ] 31 0.404% 99.687% ( 9900, 14000 ] 3 0.039% 99.726% ( 14000, 22000 ] 5 0.065% 99.791% ( 22000, 33000 ] 7 0.091% 99.883% ( 33000, 50000 ] 7 0.091% 99.974% ( 50000, 75000 ] 2 0.026% 100.000% ** DB Stats ** Uptime(secs): 6.9 total, 6.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 142.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.909 H:M:S, 27.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 143.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.909 H:M:S, 27.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/15-12:51:02 ... thread 0: (1000000,2000000) ops and (178384.2,160704.9) ops/second in (5.605877,12.445169) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.53 GB 125.2 0.9 0.0 0.9 2.7 1.8 0.0 1.5 51.7 162.3 17.02 9.59 27 0.630 894K 4926 0.0 0.0 L1 0/0 0.00 KB 0.0 0.7 0.5 0.1 0.6 0.5 0.0 1.2 109.2 108.4 6.11 3.53 2 3.057 678K 4919 0.0 0.0 L2 1/0 56.20 MB 0.6 0.1 0.1 0.0 0.1 0.1 0.4 1.0 124.2 124.2 0.80 0.47 1 0.803 101K 0 0.0 0.0 L3 26/9 1.50 GB 0.9 4.9 2.4 2.5 4.7 2.2 0.1 2.0 116.0 111.2 43.12 25.55 19 2.269 3870K 43K 0.0 0.0 L4 149/27 9.88 GB 0.8 6.1 2.3 3.8 5.5 1.6 1.0 2.4 132.3 118.2 47.22 28.50 26 1.816 1454K 3507 0.0 0.0 L5 152/0 11.50 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 339/40 24.46 GB 0.0 12.6 5.2 7.4 13.6 6.2 3.8 7.4 112.9 121.7 114.27 67.63 75 1.524 6998K 56K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.6 5.2 7.4 13.6 6.2 3.8 7.4 112.9 121.7 114.27 67.63 75 1.524 6998K 56K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.6 5.2 7.4 11.7 4.4 0.0 0.0 125.9 117.3 102.43 61.97 51 2.008 6998K 56K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 159.2 11.85 5.66 24 0.494 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.4 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.58 GB write, 1111.52 MB/s write, 12.60 GB read, 1031.22 MB/s read, 114.3 seconds Interval compaction: 13.58 GB write, 1116.92 MB/s write, 12.60 GB read, 1036.22 MB/s read, 114.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 51, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 51, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 376956 Average: 35.9059 StdDev: 361.57 Min: 1 Median: 2.0880 Max: 51373 Percentiles: P50: 2.09 P75: 3.08 P99: 753.91 P99.9: 3514.55 P99.99: 4982.54 ------------------------------------------------------ [ 0, 1 ] 10526 2.792% 2.792% # ( 1, 2 ] 169112 44.863% 47.655% ######### ( 2, 3 ] 100447 26.647% 74.302% ##### ( 3, 4 ] 33766 8.958% 83.259% ## ( 4, 6 ] 35354 9.379% 92.638% ## ( 6, 10 ] 9121 2.420% 95.058% ( 10, 15 ] 1988 0.527% 95.585% ( 15, 22 ] 266 0.071% 95.656% ( 22, 34 ] 19 0.005% 95.661% ( 34, 51 ] 28 0.007% 95.668% ( 51, 76 ] 27 0.007% 95.675% ( 76, 110 ] 17 0.005% 95.680% ( 110, 170 ] 520 0.138% 95.818% ( 170, 250 ] 2735 0.726% 96.543% ( 250, 380 ] 3640 0.966% 97.509% ( 380, 580 ] 3828 1.016% 98.524% ( 580, 870 ] 2989 0.793% 99.317% ( 870, 1300 ] 1175 0.312% 99.629% ( 1300, 1900 ] 391 0.104% 99.733% ( 1900, 2900 ] 417 0.111% 99.843% ( 2900, 4400 ] 520 0.138% 99.981% ( 4400, 6600 ] 122 0.032% 100.014% ( 6600, 9900 ] 28 0.007% 100.021% ( 9900, 14000 ] 11 0.003% 100.024% ( 14000, 22000 ] 32 0.008% 100.033% ( 22000, 33000 ] 14 0.004% 100.036% ( 33000, 50000 ] 4 0.001% 100.037% ( 50000, 75000 ] 1 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 152641 Average: 15.6206 StdDev: 260.95 Min: 1 Median: 2.2425 Max: 43249 Percentiles: P50: 2.24 P75: 3.15 P99: 274.70 P99.9: 2622.55 P99.99: 4992.76 ------------------------------------------------------ [ 0, 1 ] 1474 0.966% 0.966% ( 1, 2 ] 63399 41.535% 42.500% ######## ( 2, 3 ] 47207 30.927% 73.427% ###### ( 3, 4 ] 15875 10.400% 83.827% ## ( 4, 6 ] 17217 11.279% 95.107% ## ( 6, 10 ] 4695 3.076% 98.183% # ( 10, 15 ] 818 0.536% 98.719% ( 15, 22 ] 92 0.060% 98.779% ( 22, 34 ] 17 0.011% 98.790% ( 34, 51 ] 32 0.021% 98.811% ( 51, 76 ] 23 0.015% 98.826% ( 76, 110 ] 4 0.003% 98.829% ( 110, 170 ] 37 0.024% 98.853% ( 170, 250 ] 175 0.115% 98.968% ( 250, 380 ] 261 0.171% 99.139% ( 380, 580 ] 445 0.292% 99.430% ( 580, 870 ] 443 0.290% 99.720% ( 870, 1300 ] 156 0.102% 99.822% ( 1300, 1900 ] 62 0.041% 99.863% ( 1900, 2900 ] 78 0.051% 99.914% ( 2900, 4400 ] 109 0.071% 99.986% ( 4400, 6600 ] 25 0.016% 100.002% ( 6600, 9900 ] 6 0.004% 100.006% ( 9900, 14000 ] 3 0.002% 100.008% ( 14000, 22000 ] 4 0.003% 100.010% ( 22000, 33000 ] 2 0.001% 100.012% ( 33000, 50000 ] 2 0.001% 100.013% ** Level 2 read latency histogram (micros): Count: 414839 Average: 16.6288 StdDev: 304.78 Min: 1 Median: 2.2964 Max: 41567 Percentiles: P50: 2.30 P75: 3.32 P99: 13.58 P99.9: 1751.04 P99.99: 3004.39 ------------------------------------------------------ [ 0, 1 ] 3841 0.926% 0.926% ( 1, 2 ] 166189 40.061% 40.987% ######## ( 2, 3 ] 126148 30.409% 71.396% ###### ( 3, 4 ] 46642 11.243% 82.639% ## ( 4, 6 ] 52651 12.692% 95.331% ### ( 6, 10 ] 12939 3.119% 98.450% # ( 10, 15 ] 3187 0.768% 99.218% ( 15, 22 ] 489 0.118% 99.336% ( 22, 34 ] 81 0.020% 99.356% ( 34, 51 ] 102 0.025% 99.380% ( 51, 76 ] 64 0.015% 99.396% ( 76, 110 ] 20 0.005% 99.401% ( 110, 170 ] 26 0.006% 99.407% ( 170, 250 ] 72 0.017% 99.424% ( 250, 380 ] 284 0.068% 99.493% ( 380, 580 ] 599 0.144% 99.637% ( 580, 870 ] 607 0.146% 99.784% ( 870, 1300 ] 305 0.074% 99.857% ( 1300, 1900 ] 237 0.057% 99.914% ( 1900, 2900 ] 288 0.069% 99.984% ( 2900, 4400 ] 381 0.092% 100.075% ( 4400, 6600 ] 120 0.029% 100.104% ( 6600, 9900 ] 46 0.011% 100.115% ( 9900, 14000 ] 11 0.003% 100.118% ( 14000, 22000 ] 19 0.005% 100.123% ( 22000, 33000 ] 15 0.004% 100.126% ( 33000, 50000 ] 5 0.001% 100.128% ** Level 3 read latency histogram (micros): Count: 1178413 Average: 16.9511 StdDev: 269.21 Min: 1 Median: 2.3246 Max: 45962 Percentiles: P50: 2.32 P75: 3.31 P99: 89.05 P99.9: 1238.93 P99.99: 2267.45 ------------------------------------------------------ [ 0, 1 ] 7958 0.675% 0.675% ( 1, 2 ] 458990 38.950% 39.625% ######## ( 2, 3 ] 376682 31.965% 71.590% ###### ( 3, 4 ] 130152 11.045% 82.635% ## ( 4, 6 ] 147504 12.517% 95.152% ### ( 6, 10 ] 36030 3.058% 98.210% # ( 10, 15 ] 7536 0.640% 98.849% ( 15, 22 ] 914 0.078% 98.927% ( 22, 34 ] 183 0.016% 98.942% ( 34, 51 ] 380 0.032% 98.975% ( 51, 76 ] 269 0.023% 98.997% ( 76, 110 ] 83 0.007% 99.004% ( 110, 170 ] 259 0.022% 99.026% ( 170, 250 ] 1259 0.107% 99.133% ( 250, 380 ] 2255 0.191% 99.325% ( 380, 580 ] 3124 0.265% 99.590% ( 580, 870 ] 2604 0.221% 99.811% ( 870, 1300 ] 1228 0.104% 99.915% ( 1300, 1900 ] 608 0.052% 99.966% ( 1900, 2900 ] 757 0.064% 100.031% ( 2900, 4400 ] 1040 0.088% 100.119% ( 4400, 6600 ] 252 0.021% 100.140% ( 6600, 9900 ] 82 0.007% 100.147% ( 9900, 14000 ] 27 0.002% 100.150% ( 14000, 22000 ] 48 0.004% 100.154% ( 22000, 33000 ] 30 0.003% 100.156% ( 33000, 50000 ] 8 0.001% 100.157% ** Level 4 read latency histogram (micros): Count: 1061991 Average: 28.8441 StdDev: 371.88 Min: 1 Median: 2.3659 Max: 71446 Percentiles: P50: 2.37 P75: 3.47 P99: 539.36 P99.9: 1623.76 P99.99: 2323.04 ------------------------------------------------------ [ 0, 1 ] 7891 0.743% 0.743% ( 1, 2 ] 403064 37.954% 38.697% ######## ( 2, 3 ] 328054 30.890% 69.587% ###### ( 3, 4 ] 121653 11.455% 81.042% ## ( 4, 6 ] 135045 12.716% 93.759% ### ( 6, 10 ] 32349 3.046% 96.805% # ( 10, 15 ] 6737 0.634% 97.439% ( 15, 22 ] 820 0.077% 97.516% ( 22, 34 ] 174 0.016% 97.533% ( 34, 51 ] 415 0.039% 97.572% ( 51, 76 ] 308 0.029% 97.601% ( 76, 110 ] 102 0.010% 97.610% ( 110, 170 ] 702 0.066% 97.676% ( 170, 250 ] 3479 0.328% 98.004% ( 250, 380 ] 5208 0.490% 98.494% ( 380, 580 ] 6742 0.635% 99.129% ( 580, 870 ] 5341 0.503% 99.632% ( 870, 1300 ] 2295 0.216% 99.848% ( 1300, 1900 ] 1023 0.096% 99.945% ( 1900, 2900 ] 1146 0.108% 100.052% ( 2900, 4400 ] 1534 0.144% 100.197% ( 4400, 6600 ] 377 0.035% 100.232% ( 6600, 9900 ] 113 0.011% 100.243% ( 9900, 14000 ] 20 0.002% 100.245% ( 14000, 22000 ] 38 0.004% 100.248% ( 22000, 33000 ] 36 0.003% 100.252% ( 33000, 50000 ] 19 0.002% 100.254% ( 50000, 75000 ] 6 0.001% 100.254% ** Level 5 read latency histogram (micros): Count: 18828 Average: 848.7637 StdDev: 1673.81 Min: 94 Median: 497.2710 Max: 62960 Percentiles: P50: 497.27 P75: 800.37 P99: 5569.74 P99.9: 27222.46 P99.99: 48635.67 ------------------------------------------------------ ( 76, 110 ] 18 0.096% 0.096% ( 110, 170 ] 515 2.735% 2.831% # ( 170, 250 ] 2505 13.305% 16.136% ### ( 250, 380 ] 3643 19.349% 35.484% #### ( 380, 580 ] 4661 24.756% 60.240% ##### ( 580, 870 ] 3657 19.423% 79.663% #### ( 870, 1300 ] 1542 8.190% 87.853% ## ( 1300, 1900 ] 557 2.958% 90.812% # ( 1900, 2900 ] 592 3.144% 93.956% # ( 2900, 4400 ] 837 4.446% 98.401% # ( 4400, 6600 ] 212 1.126% 99.527% ( 6600, 9900 ] 43 0.228% 99.756% ( 9900, 14000 ] 9 0.048% 99.803% ( 14000, 22000 ] 12 0.064% 99.867% ( 22000, 33000 ] 13 0.069% 99.936% ( 33000, 50000 ] 11 0.058% 99.995% ( 50000, 75000 ] 2 0.011% 100.005% ** DB Stats ** Uptime(secs): 12.5 total, 5.6 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 157.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.056 H:M:S, 24.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 175.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.147 H:M:S, 20.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/15-12:51:06 ... thread 0: (1000000,3000000) ops and (228387.8,178320.0) ops/second in (4.378518,16.823687) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 2.51 GB 18.9 2.0 0.0 2.0 4.8 2.8 0.0 1.7 59.4 141.8 34.95 17.55 46 0.760 2107K 11K 0.0 0.0 L1 0/0 0.00 KB 0.0 0.7 0.5 0.1 0.6 0.5 0.0 1.2 109.2 108.4 6.11 3.53 2 3.057 678K 4919 0.0 0.0 L2 1/0 56.20 MB 0.6 0.1 0.1 0.0 0.1 0.1 0.4 1.0 124.2 124.2 0.80 0.47 1 0.803 101K 0 0.0 0.0 L3 17/0 939.17 MB 0.9 4.9 2.4 2.5 4.7 2.2 0.1 2.0 116.0 111.2 43.12 25.55 19 2.269 3870K 43K 0.0 0.0 L4 153/0 9.70 GB 1.0 8.8 2.8 5.9 7.7 1.7 1.0 2.7 140.9 122.8 63.86 39.57 35 1.825 2070K 3840 0.0 0.0 L5 156/0 11.79 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 341/11 24.96 GB 0.0 16.4 5.8 10.6 17.9 7.3 4.1 6.3 113.2 123.3 148.85 86.66 103 1.445 8828K 63K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.4 5.8 10.6 17.9 7.3 4.1 6.3 113.2 123.3 148.85 86.66 103 1.445 8828K 63K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.4 5.8 10.6 15.1 4.5 0.0 0.0 126.7 116.3 132.96 78.18 64 2.077 8828K 63K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 182.1 15.89 8.48 39 0.407 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.9 total, 16.8 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.93 GB write, 1087.22 MB/s write, 16.45 GB read, 997.42 MB/s read, 148.8 seconds Interval compaction: 17.93 GB write, 1091.12 MB/s write, 16.45 GB read, 1001.01 MB/s read, 148.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 53, interval: 53 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 682757 Average: 29.9803 StdDev: 287.41 Min: 0 Median: 1.8921 Max: 51373 Percentiles: P50: 1.89 P75: 2.86 P99: 623.07 P99.9: 2730.82 P99.99: 3997.44 ------------------------------------------------------ [ 0, 1 ] 39854 5.837% 5.837% # ( 1, 2 ] 338000 49.505% 55.342% ########## ( 2, 3 ] 156324 22.896% 78.238% ##### ( 3, 4 ] 49804 7.295% 85.533% # ( 4, 6 ] 49721 7.282% 92.815% # ( 6, 10 ] 13918 2.038% 94.854% ( 10, 15 ] 2678 0.392% 95.246% ( 15, 22 ] 342 0.050% 95.296% ( 22, 34 ] 38 0.006% 95.302% ( 34, 51 ] 37 0.005% 95.307% ( 51, 76 ] 37 0.005% 95.313% ( 76, 110 ] 113 0.017% 95.329% ( 110, 170 ] 3199 0.469% 95.798% ( 170, 250 ] 9296 1.362% 97.159% ( 250, 380 ] 6275 0.919% 98.078% ( 380, 580 ] 5683 0.832% 98.911% ( 580, 870 ] 4124 0.604% 99.515% ( 870, 1300 ] 1648 0.241% 99.756% ( 1300, 1900 ] 515 0.075% 99.831% ( 1900, 2900 ] 566 0.083% 99.914% ( 2900, 4400 ] 709 0.104% 100.018% ( 4400, 6600 ] 177 0.026% 100.044% ( 6600, 9900 ] 31 0.005% 100.049% ( 9900, 14000 ] 12 0.002% 100.050% ( 14000, 22000 ] 32 0.005% 100.055% ( 22000, 33000 ] 14 0.002% 100.057% ( 33000, 50000 ] 4 0.001% 100.058% ( 50000, 75000 ] 1 0.000% 100.058% ** Level 1 read latency histogram (micros): Count: 152825 Average: 16.0030 StdDev: 261.53 Min: 1 Median: 2.2444 Max: 43249 Percentiles: P50: 2.24 P75: 3.16 P99: 298.48 P99.9: 2649.05 P99.99: 5053.02 ------------------------------------------------------ [ 0, 1 ] 1474 0.965% 0.965% ( 1, 2 ] 63399 41.485% 42.449% ######## ( 2, 3 ] 47207 30.890% 73.339% ###### ( 3, 4 ] 15875 10.388% 83.726% ## ( 4, 6 ] 17217 11.266% 94.992% ## ( 6, 10 ] 4695 3.072% 98.064% # ( 10, 15 ] 818 0.535% 98.600% ( 15, 22 ] 92 0.060% 98.660% ( 22, 34 ] 17 0.011% 98.671% ( 34, 51 ] 32 0.021% 98.692% ( 51, 76 ] 23 0.015% 98.707% ( 76, 110 ] 7 0.005% 98.712% ( 110, 170 ] 76 0.050% 98.761% ( 170, 250 ] 254 0.166% 98.928% ( 250, 380 ] 297 0.194% 99.122% ( 380, 580 ] 453 0.296% 99.418% ( 580, 870 ] 452 0.296% 99.714% ( 870, 1300 ] 161 0.105% 99.819% ( 1300, 1900 ] 64 0.042% 99.861% ( 1900, 2900 ] 79 0.052% 99.913% ( 2900, 4400 ] 110 0.072% 99.985% ( 4400, 6600 ] 26 0.017% 100.002% ( 6600, 9900 ] 6 0.004% 100.006% ( 9900, 14000 ] 3 0.002% 100.008% ( 14000, 22000 ] 4 0.003% 100.010% ( 22000, 33000 ] 2 0.001% 100.012% ( 33000, 50000 ] 2 0.001% 100.013% ** Level 2 read latency histogram (micros): Count: 414839 Average: 16.6288 StdDev: 304.78 Min: 1 Median: 2.2964 Max: 41567 Percentiles: P50: 2.30 P75: 3.32 P99: 13.58 P99.9: 1751.04 P99.99: 3004.39 ------------------------------------------------------ [ 0, 1 ] 3841 0.926% 0.926% ( 1, 2 ] 166189 40.061% 40.987% ######## ( 2, 3 ] 126148 30.409% 71.396% ###### ( 3, 4 ] 46642 11.243% 82.639% ## ( 4, 6 ] 52651 12.692% 95.331% ### ( 6, 10 ] 12939 3.119% 98.450% # ( 10, 15 ] 3187 0.768% 99.218% ( 15, 22 ] 489 0.118% 99.336% ( 22, 34 ] 81 0.020% 99.356% ( 34, 51 ] 102 0.025% 99.380% ( 51, 76 ] 64 0.015% 99.396% ( 76, 110 ] 20 0.005% 99.401% ( 110, 170 ] 26 0.006% 99.407% ( 170, 250 ] 72 0.017% 99.424% ( 250, 380 ] 284 0.068% 99.493% ( 380, 580 ] 599 0.144% 99.637% ( 580, 870 ] 607 0.146% 99.784% ( 870, 1300 ] 305 0.074% 99.857% ( 1300, 1900 ] 237 0.057% 99.914% ( 1900, 2900 ] 288 0.069% 99.984% ( 2900, 4400 ] 381 0.092% 100.075% ( 4400, 6600 ] 120 0.029% 100.104% ( 6600, 9900 ] 46 0.011% 100.115% ( 9900, 14000 ] 11 0.003% 100.118% ( 14000, 22000 ] 19 0.005% 100.123% ( 22000, 33000 ] 15 0.004% 100.126% ( 33000, 50000 ] 5 0.001% 100.128% ** Level 3 read latency histogram (micros): Count: 1316778 Average: 17.0943 StdDev: 259.33 Min: 1 Median: 2.3340 Max: 45962 Percentiles: P50: 2.33 P75: 3.34 P99: 218.27 P99.9: 1243.35 P99.99: 2272.26 ------------------------------------------------------ [ 0, 1 ] 8933 0.678% 0.678% ( 1, 2 ] 509060 38.660% 39.338% ######## ( 2, 3 ] 420393 31.926% 71.264% ###### ( 3, 4 ] 145937 11.083% 82.347% ## ( 4, 6 ] 165566 12.574% 94.920% ### ( 6, 10 ] 40436 3.071% 97.991% # ( 10, 15 ] 8526 0.647% 98.639% ( 15, 22 ] 1029 0.078% 98.717% ( 22, 34 ] 207 0.016% 98.732% ( 34, 51 ] 446 0.034% 98.766% ( 51, 76 ] 292 0.022% 98.788% ( 76, 110 ] 113 0.009% 98.797% ( 110, 170 ] 960 0.073% 98.870% ( 170, 250 ] 2838 0.216% 99.085% ( 250, 380 ] 2902 0.220% 99.306% ( 380, 580 ] 3622 0.275% 99.581% ( 580, 870 ] 2957 0.225% 99.806% ( 870, 1300 ] 1433 0.109% 99.914% ( 1300, 1900 ] 684 0.052% 99.966% ( 1900, 2900 ] 839 0.064% 100.030% ( 2900, 4400 ] 1128 0.086% 100.116% ( 4400, 6600 ] 275 0.021% 100.137% ( 6600, 9900 ] 85 0.006% 100.143% ( 9900, 14000 ] 27 0.002% 100.145% ( 14000, 22000 ] 48 0.004% 100.149% ( 22000, 33000 ] 30 0.002% 100.151% ( 33000, 50000 ] 8 0.001% 100.152% ** Level 4 read latency histogram (micros): Count: 1545296 Average: 26.4832 StdDev: 320.76 Min: 1 Median: 2.3843 Max: 71446 Percentiles: P50: 2.38 P75: 3.53 P99: 468.78 P99.9: 1209.38 P99.99: 1660.03 ------------------------------------------------------ [ 0, 1 ] 11161 0.722% 0.722% ( 1, 2 ] 578881 37.461% 38.183% ####### ( 2, 3 ] 475207 30.752% 68.935% ###### ( 3, 4 ] 177703 11.500% 80.435% ## ( 4, 6 ] 197607 12.788% 93.222% ### ( 6, 10 ] 47524 3.075% 96.298% # ( 10, 15 ] 10192 0.660% 96.957% ( 15, 22 ] 1241 0.080% 97.037% ( 22, 34 ] 237 0.015% 97.053% ( 34, 51 ] 551 0.036% 97.088% ( 51, 76 ] 407 0.026% 97.115% ( 76, 110 ] 272 0.018% 97.132% ( 110, 170 ] 4465 0.289% 97.421% ( 170, 250 ] 12063 0.781% 98.202% ( 250, 380 ] 8393 0.543% 98.745% ( 380, 580 ] 8874 0.574% 99.319% ( 580, 870 ] 6672 0.432% 99.751% ( 870, 1300 ] 2915 0.189% 99.940% ( 1300, 1900 ] 1294 0.084% 100.023% ( 1900, 2900 ] 1470 0.095% 100.119% ( 2900, 4400 ] 1872 0.121% 100.240% ( 4400, 6600 ] 474 0.031% 100.270% ( 6600, 9900 ] 125 0.008% 100.279% ( 9900, 14000 ] 20 0.001% 100.280% ( 14000, 22000 ] 38 0.002% 100.282% ( 22000, 33000 ] 36 0.002% 100.285% ( 33000, 50000 ] 19 0.001% 100.286% ( 50000, 75000 ] 6 0.000% 100.286% ** Level 5 read latency histogram (micros): Count: 33015 Average: 633.8464 StdDev: 1327.61 Min: 93 Median: 344.6918 Max: 62960 Percentiles: P50: 344.69 P75: 626.08 P99: 4452.75 P99.9: 16656.67 P99.99: 46443.14 ------------------------------------------------------ ( 76, 110 ] 124 0.376% 0.376% ( 110, 170 ] 3167 9.593% 9.968% ## ( 170, 250 ] 8892 26.933% 36.901% ##### ( 250, 380 ] 5937 17.983% 54.884% #### ( 380, 580 ] 5934 17.974% 72.858% #### ( 580, 870 ] 4451 13.482% 86.340% ### ( 870, 1300 ] 1851 5.607% 91.946% # ( 1300, 1900 ] 638 1.932% 93.879% ( 1900, 2900 ] 703 2.129% 96.008% ( 2900, 4400 ] 982 2.974% 98.982% # ( 4400, 6600 ] 244 0.739% 99.721% ( 6600, 9900 ] 46 0.139% 99.861% ( 9900, 14000 ] 9 0.027% 99.888% ( 14000, 22000 ] 12 0.036% 99.924% ( 22000, 33000 ] 13 0.039% 99.964% ( 33000, 50000 ] 11 0.033% 99.997% ( 50000, 75000 ] 2 0.006% 100.003% ** DB Stats ** Uptime(secs): 16.9 total, 4.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 174.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.494 H:M:S, 20.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 224.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.438 H:M:S, 10.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 542.385 micros/op 7345 ops/sec 20.147 seconds 147996 operations; 7.1 MB/s (36999 of 36999 found) Microseconds per read: Count: 147996 Average: 542.4069 StdDev: 1524.44 Min: 2 Median: 287.3217 Max: 166896 Percentiles: P50: 287.32 P75: 511.13 P99: 4334.10 P99.9: 21380.51 P99.99: 49253.82 ------------------------------------------------------ ( 1, 2 ] 4 0.003% 0.003% ( 2, 3 ] 34 0.023% 0.026% ( 3, 4 ] 56 0.038% 0.064% ( 4, 6 ] 148 0.100% 0.164% ( 6, 10 ] 255 0.172% 0.336% ( 10, 15 ] 780 0.527% 0.863% ( 15, 22 ] 1961 1.325% 2.188% ( 22, 34 ] 2694 1.820% 4.008% ( 34, 51 ] 1678 1.134% 5.142% ( 51, 76 ] 253 0.171% 5.313% ( 76, 110 ] 85 0.057% 5.370% ( 110, 170 ] 7581 5.122% 10.493% # ( 170, 250 ] 49525 33.464% 43.957% ####### ( 250, 380 ] 31154 21.051% 65.007% #### ( 380, 580 ] 22556 15.241% 80.248% ### ( 580, 870 ] 14694 9.929% 90.177% ## ( 870, 1300 ] 6440 4.351% 94.528% # ( 1300, 1900 ] 2395 1.618% 96.147% ( 1900, 2900 ] 1765 1.193% 97.339% ( 2900, 4400 ] 2571 1.737% 99.076% ( 4400, 6600 ] 717 0.484% 99.561% ( 6600, 9900 ] 251 0.170% 99.730% ( 9900, 14000 ] 120 0.081% 99.811% ( 14000, 22000 ] 142 0.096% 99.907% ( 22000, 33000 ] 83 0.056% 99.964% ( 33000, 50000 ] 41 0.028% 99.991% ( 50000, 75000 ] 9 0.006% 99.997% ( 75000, 110000 ] 3 0.002% 99.999% ( 110000, 170000 ] 1 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2094552 rocksdb.bloom.filter.full.positive COUNT : 167600 rocksdb.bloom.filter.full.true.positive COUNT : 147222 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 774 rocksdb.memtable.miss COUNT : 147222 rocksdb.l0.hit COUNT : 14048 rocksdb.l1.hit COUNT : 171 rocksdb.l2andup.hit COUNT : 133003 rocksdb.compaction.key.drop.new COUNT : 1405781 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3834308 rocksdb.number.keys.read COUNT : 147996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3957005856 rocksdb.bytes.read COUNT : 147996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 593 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 3749310 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 18544549099 rocksdb.compact.write.bytes COUNT : 17093539798 rocksdb.flush.write.bytes COUNT : 3890720405 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 29 rocksdb.number.superversion_acquires COUNT : 797 rocksdb.number.superversion_releases COUNT : 777 rocksdb.number.superversion_cleanups COUNT : 199 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 237 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3865949184 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7564288 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 18472410944 rocksdb.non.last.level.read.count COUNT : 4437080 rocksdb.block.checksum.compute.count COUNT : 4662557 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 285.617017 P95 : 1473.879599 P99 : 4333.512252 P100 : 166895.000000 COUNT : 147996 SUM : 80140105 rocksdb.db.write.micros P50 : 1.635696 P95 : 5.111770 P99 : 7.232562 P100 : 631061.000000 COUNT : 3834308 SUM : 14852470 rocksdb.compaction.times.micros P50 : 1886000.000000 P95 : 3751666.666667 P99 : 9829091.000000 P100 : 9829091.000000 COUNT : 67 SUM : 135855217 rocksdb.compaction.times.cpu_micros P50 : 1232812.500000 P95 : 1892343.750000 P99 : 2596351.000000 P100 : 2596351.000000 COUNT : 67 SUM : 81008125 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1049.166667 P95 : 8910.000000 P99 : 15712.000000 P100 : 15712.000000 COUNT : 52 SUM : 104471 rocksdb.compaction.outfile.sync.micros P50 : 2400.000000 P95 : 6946.500000 P99 : 11150.500000 P100 : 54188.000000 COUNT : 239 SUM : 738528 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 290.625000 P95 : 2516.666667 P99 : 3829.000000 P100 : 3829.000000 COUNT : 143 SUM : 77550 rocksdb.table.open.io.micros P50 : 5147.435897 P95 : 18530.232558 P99 : 29967.142857 P100 : 118785.000000 COUNT : 593 SUM : 3872481 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.597782 P95 : 9.711621 P99 : 184.129075 P100 : 98229.000000 COUNT : 4492267 SUM : 72031051 rocksdb.read.block.get.micros P50 : 229.660042 P95 : 1228.394541 P99 : 4026.154665 P100 : 71454.000000 COUNT : 169958 SUM : 73218652 rocksdb.write.raw.block.micros P50 : 0.533334 P95 : 1.315892 P99 : 3.902471 P100 : 143707.000000 COUNT : 5084037 SUM : 20327374 rocksdb.numfiles.in.singlecompaction P50 : 3.105263 P95 : 5.850000 P99 : 10.400000 P100 : 11.000000 COUNT : 92 SUM : 326 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562223 P95 : 1123.264317 P99 : 1296.476652 P100 : 630849.000000 COUNT : 2286 SUM : 3749515 rocksdb.sst.read.micros P50 : 2.259131 P95 : 13.122097 P99 : 565.440865 P100 : 71446.000000 COUNT : 4437538 SUM : 128733002 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 147996 SUM : 147996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3834308 SUM : 3957005856 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 244285.714286 P95 : 802000.000000 P99 : 942408.000000 P100 : 942408.000000 COUNT : 52 SUM : 18359942 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 248 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0