[2024-07-12 11:22:02.863977] Starting SPDK v24.09-pre git sha1 719d03c6a / DPDK 24.03.0 initialization... [2024-07-12 11:22:02.864308] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid429617 ] Set seed to 1720776122856687 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-12 11:22:03.020220] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-12 11:22:03.235892] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-12 11:22:03.235946] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 429617' to capture a snapshot of events at runtime. [2024-07-12 11:22:03.235958] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-12 11:22:03.235971] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-12 11:22:03.235981] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid429617 for offline analysis/debug. [2024-07-12 11:22:03.236085] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 12 11:22:10 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/12-11:22:18 ... thread 0: (1000000,1000000) ops and (117509.6,117509.6) ops/second in (8.509942,8.509942) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 881.46 MB 50.4 0.3 0.0 0.3 1.2 0.9 0.0 1.4 30.9 117.4 10.19 4.08 11 0.927 319K 349 0.0 0.0 L1 2/0 99.19 MB 9.9 0.4 0.4 0.0 0.4 0.4 0.0 1.0 113.6 113.4 3.61 2.04 1 3.610 416K 505 0.0 0.0 L2 6/3 368.61 MB 1.8 0.3 0.3 0.0 0.3 0.3 0.0 1.0 107.5 107.5 2.89 1.49 1 2.885 315K 0 0.0 0.0 L3 36/14 3.22 GB 1.8 2.6 1.7 0.9 2.5 1.7 0.0 1.5 109.3 107.6 24.20 13.29 13 1.862 1719K 1038 0.0 0.0 L4 198/16 12.56 GB 1.2 4.5 3.1 1.4 4.4 3.0 0.0 1.4 117.9 116.7 39.03 22.50 27 1.446 2082K 135 0.0 0.0 L5 1120/0 89.20 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1369/37 106.29 GB 0.0 8.1 5.5 2.6 8.9 6.3 0.0 10.3 103.6 113.6 79.92 43.41 53 1.508 4853K 2027 0.0 0.0 Int 0/0 0.00 KB 0.0 8.1 5.5 2.6 8.9 6.3 0.0 10.3 103.6 113.6 79.92 43.41 53 1.508 4853K 2027 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.1 5.5 2.6 8.0 5.4 0.0 0.0 114.8 113.6 72.15 40.73 43 1.678 4853K 2027 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 113.4 7.77 2.68 10 0.777 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.7 total, 8.5 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.86 GB write, 1041.49 MB/s write, 8.09 GB read, 950.47 MB/s read, 79.9 seconds Interval compaction: 8.86 GB write, 1065.87 MB/s write, 8.09 GB read, 972.72 MB/s read, 79.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 26, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 190397 Average: 18.0119 StdDev: 252.16 Min: 1 Median: 2.2463 Max: 35203 Percentiles: P50: 2.25 P75: 3.25 P99: 14.55 P99.9: 3785.85 P99.99: 6952.07 ------------------------------------------------------ [ 0, 1 ] 2391 1.256% 1.256% ( 1, 2 ] 78952 41.467% 42.723% ######## ( 2, 3 ] 56254 29.546% 72.268% ###### ( 3, 4 ] 20520 10.777% 83.046% ## ( 4, 6 ] 23647 12.420% 95.466% ## ( 6, 10 ] 5679 2.983% 98.449% # ( 10, 15 ] 1157 0.608% 99.056% ( 15, 22 ] 192 0.101% 99.157% ( 22, 34 ] 13 0.007% 99.164% ( 34, 51 ] 15 0.008% 99.172% ( 51, 76 ] 17 0.009% 99.181% ( 76, 110 ] 9 0.005% 99.185% ( 110, 170 ] 21 0.011% 99.196% ( 170, 250 ] 38 0.020% 99.216% ( 250, 380 ] 86 0.045% 99.262% ( 380, 580 ] 184 0.097% 99.358% ( 580, 870 ] 261 0.137% 99.495% ( 870, 1300 ] 263 0.138% 99.633% ( 1300, 1900 ] 203 0.107% 99.740% ( 1900, 2900 ] 169 0.089% 99.829% ( 2900, 4400 ] 233 0.122% 99.951% ( 4400, 6600 ] 75 0.039% 99.991% ( 6600, 9900 ] 9 0.005% 99.995% ( 9900, 14000 ] 6 0.003% 99.998% ( 14000, 22000 ] 6 0.003% 100.002% ( 33000, 50000 ] 2 0.001% 100.003% ** Level 1 read latency histogram (micros): Count: 78867 Average: 17.3835 StdDev: 257.28 Min: 1 Median: 2.3732 Max: 41844 Percentiles: P50: 2.37 P75: 3.38 P99: 13.21 P99.9: 3787.00 P99.99: 6470.29 ------------------------------------------------------ [ 0, 1 ] 256 0.325% 0.325% ( 1, 2 ] 29553 37.472% 37.797% ####### ( 2, 3 ] 25789 32.699% 70.496% ####### ( 3, 4 ] 9278 11.764% 82.260% ## ( 4, 6 ] 10500 13.314% 95.574% ### ( 6, 10 ] 2394 3.035% 98.609% # ( 10, 15 ] 480 0.609% 99.218% ( 15, 22 ] 56 0.071% 99.289% ( 22, 34 ] 7 0.009% 99.298% ( 34, 51 ] 16 0.020% 99.318% ( 51, 76 ] 16 0.020% 99.338% ( 76, 110 ] 4 0.005% 99.343% ( 110, 170 ] 3 0.004% 99.347% ( 170, 250 ] 9 0.011% 99.358% ( 250, 380 ] 26 0.033% 99.391% ( 380, 580 ] 35 0.044% 99.436% ( 580, 870 ] 59 0.075% 99.511% ( 870, 1300 ] 68 0.086% 99.597% ( 1300, 1900 ] 90 0.114% 99.711% ( 1900, 2900 ] 90 0.114% 99.825% ( 2900, 4400 ] 100 0.127% 99.952% ( 4400, 6600 ] 32 0.041% 99.992% ( 6600, 9900 ] 4 0.005% 99.997% ( 9900, 14000 ] 1 0.001% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 420281 Average: 16.9607 StdDev: 246.28 Min: 1 Median: 2.3123 Max: 40683 Percentiles: P50: 2.31 P75: 3.40 P99: 12.76 P99.9: 2147.31 P99.99: 3165.67 ------------------------------------------------------ [ 0, 1 ] 4295 1.022% 1.022% ( 1, 2 ] 166752 39.676% 40.698% ######## ( 2, 3 ] 125193 29.788% 70.486% ###### ( 3, 4 ] 47940 11.407% 81.893% ## ( 4, 6 ] 55955 13.314% 95.207% ### ( 6, 10 ] 13843 3.294% 98.500% # ( 10, 15 ] 3804 0.905% 99.405% ( 15, 22 ] 609 0.145% 99.550% ( 22, 34 ] 69 0.016% 99.567% ( 34, 51 ] 59 0.014% 99.581% ( 51, 76 ] 45 0.011% 99.591% ( 76, 110 ] 18 0.004% 99.596% ( 110, 170 ] 30 0.007% 99.603% ( 170, 250 ] 50 0.012% 99.615% ( 250, 380 ] 90 0.021% 99.636% ( 380, 580 ] 167 0.040% 99.676% ( 580, 870 ] 251 0.060% 99.736% ( 870, 1300 ] 282 0.067% 99.803% ( 1300, 1900 ] 314 0.075% 99.877% ( 1900, 2900 ] 383 0.091% 99.969% ( 2900, 4400 ] 508 0.121% 100.089% ( 4400, 6600 ] 227 0.054% 100.143% ( 6600, 9900 ] 51 0.012% 100.156% ( 9900, 14000 ] 11 0.003% 100.158% ( 14000, 22000 ] 7 0.002% 100.160% ( 22000, 33000 ] 2 0.000% 100.160% ( 33000, 50000 ] 1 0.000% 100.161% ** Level 3 read latency histogram (micros): Count: 1088182 Average: 11.8432 StdDev: 217.12 Min: 1 Median: 2.2862 Max: 56334 Percentiles: P50: 2.29 P75: 3.23 P99: 9.70 P99.9: 588.46 P99.99: 1214.41 ------------------------------------------------------ [ 0, 1 ] 7091 0.652% 0.652% ( 1, 2 ] 439706 40.407% 41.059% ######## ( 2, 3 ] 339939 31.239% 72.298% ###### ( 3, 4 ] 125516 11.534% 83.833% ## ( 4, 6 ] 137869 12.670% 96.502% ### ( 6, 10 ] 29403 2.702% 99.204% # ( 10, 15 ] 5693 0.523% 99.728% ( 15, 22 ] 751 0.069% 99.797% ( 22, 34 ] 107 0.010% 99.806% ( 34, 51 ] 109 0.010% 99.816% ( 51, 76 ] 126 0.012% 99.828% ( 76, 110 ] 52 0.005% 99.833% ( 110, 170 ] 59 0.005% 99.838% ( 170, 250 ] 62 0.006% 99.844% ( 250, 380 ] 203 0.019% 99.863% ( 380, 580 ] 394 0.036% 99.899% ( 580, 870 ] 508 0.047% 99.945% ( 870, 1300 ] 607 0.056% 100.001% ( 1300, 1900 ] 600 0.055% 100.056% ( 1900, 2900 ] 714 0.066% 100.122% ( 2900, 4400 ] 800 0.074% 100.195% ( 4400, 6600 ] 268 0.025% 100.220% ( 6600, 9900 ] 56 0.005% 100.225% ( 9900, 14000 ] 18 0.002% 100.227% ( 14000, 22000 ] 9 0.001% 100.228% ( 22000, 33000 ] 9 0.001% 100.229% ( 33000, 50000 ] 5 0.000% 100.229% ( 50000, 75000 ] 1 0.000% 100.229% ** Level 4 read latency histogram (micros): Count: 457797 Average: 27.1608 StdDev: 336.08 Min: 1 Median: 2.2830 Max: 62886 Percentiles: P50: 2.28 P75: 3.25 P99: 371.86 P99.9: 3469.13 P99.99: 4160.44 ------------------------------------------------------ [ 0, 1 ] 3391 0.741% 0.741% ( 1, 2 ] 185384 40.495% 41.236% ######## ( 2, 3 ] 141804 30.975% 72.211% ###### ( 3, 4 ] 51776 11.310% 83.521% ## ( 4, 6 ] 54518 11.909% 95.429% ## ( 6, 10 ] 13097 2.861% 98.290% # ( 10, 15 ] 2323 0.507% 98.798% ( 15, 22 ] 325 0.071% 98.869% ( 22, 34 ] 40 0.009% 98.877% ( 34, 51 ] 41 0.009% 98.886% ( 51, 76 ] 71 0.016% 98.902% ( 76, 110 ] 18 0.004% 98.906% ( 110, 170 ] 40 0.009% 98.915% ( 170, 250 ] 138 0.030% 98.945% ( 250, 380 ] 271 0.059% 99.004% ( 380, 580 ] 510 0.111% 99.115% ( 580, 870 ] 699 0.153% 99.268% ( 870, 1300 ] 859 0.188% 99.456% ( 1300, 1900 ] 799 0.175% 99.630% ( 1900, 2900 ] 897 0.196% 99.826% ( 2900, 4400 ] 894 0.195% 100.021% ( 4400, 6600 ] 300 0.066% 100.087% ( 6600, 9900 ] 46 0.010% 100.097% ( 9900, 14000 ] 6 0.001% 100.098% ( 14000, 22000 ] 14 0.003% 100.101% ( 22000, 33000 ] 10 0.002% 100.104% ( 33000, 50000 ] 2 0.000% 100.104% ( 50000, 75000 ] 2 0.000% 100.104% ** Level 5 read latency histogram (micros): Count: 12585 Average: 1922.2287 StdDev: 2465.12 Min: 98 Median: 1328.6790 Max: 87394 Percentiles: P50: 1328.68 P75: 2727.05 P99: 7456.62 P99.9: 35405.50 P99.99: 67134.37 ------------------------------------------------------ ( 76, 110 ] 1 0.008% 0.008% ( 110, 170 ] 42 0.334% 0.342% ( 170, 250 ] 219 1.740% 2.082% ( 250, 380 ] 691 5.491% 7.573% # ( 380, 580 ] 1439 11.434% 19.007% ## ( 580, 870 ] 1908 15.161% 34.168% ### ( 870, 1300 ] 1910 15.177% 49.344% ### ( 1300, 1900 ] 1726 13.715% 63.059% ### ( 1900, 2900 ] 1817 14.438% 77.497% ### ( 2900, 4400 ] 1948 15.479% 92.976% ### ( 4400, 6600 ] 727 5.777% 98.752% # ( 6600, 9900 ] 120 0.954% 99.706% ( 9900, 14000 ] 7 0.056% 99.762% ( 14000, 22000 ] 7 0.056% 99.817% ( 22000, 33000 ] 9 0.072% 99.889% ( 33000, 50000 ] 10 0.079% 99.968% ( 50000, 75000 ] 4 0.032% 100.000% ( 75000, 110000 ] 2 0.016% 100.016% ** DB Stats ** Uptime(secs): 8.7 total, 8.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 112.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.739 H:M:S, 42.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 115.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.739 H:M:S, 43.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/12-11:22:24 ... thread 0: (1000000,2000000) ops and (171109.1,139332.4) ops/second in (5.844223,14.354165) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 1.78 GB 44.1 1.0 0.0 1.0 2.8 1.8 0.0 1.6 51.2 144.0 19.68 9.83 26 0.757 1023K 1237 0.0 0.0 L1 2/2 99.19 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.0 1.0 113.6 113.4 3.61 2.04 1 3.610 416K 505 0.0 0.0 L2 1/0 61.43 MB 0.6 0.3 0.3 0.0 0.3 0.3 0.0 1.0 107.5 107.5 2.89 1.49 1 2.885 315K 0 0.0 0.0 L3 17/1 1.03 GB 0.9 3.8 2.0 1.8 3.7 1.9 0.1 1.9 108.4 106.9 35.57 19.40 17 2.092 1960K 1038 0.0 0.0 L4 163/5 9.72 GB 1.0 9.6 5.3 4.3 9.4 5.1 0.3 1.8 125.6 123.9 77.98 47.68 46 1.695 4080K 2421 0.0 0.0 L5 1184/0 94.43 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1381/19 107.12 GB 0.0 15.0 7.9 7.1 16.6 9.5 5.6 9.3 110.1 121.8 139.73 80.44 91 1.535 7796K 5201 0.0 0.0 Int 0/0 0.00 KB 0.0 15.0 7.9 7.1 16.6 9.5 5.6 9.3 110.1 121.8 139.73 80.44 91 1.535 7796K 5201 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.0 7.9 7.1 14.8 7.7 0.0 0.0 122.0 120.5 126.12 74.99 68 1.855 7796K 5201 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 134.2 13.61 5.45 23 0.592 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.6 total, 14.4 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.62 GB write, 1168.83 MB/s write, 15.02 GB read, 1056.35 MB/s read, 139.7 seconds Interval compaction: 16.62 GB write, 1185.05 MB/s write, 15.02 GB read, 1071.02 MB/s read, 139.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 35, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 416340 Average: 22.1765 StdDev: 252.05 Min: 1 Median: 2.0924 Max: 48975 Percentiles: P50: 2.09 P75: 3.00 P99: 513.36 P99.9: 3494.40 P99.99: 5826.42 ------------------------------------------------------ [ 0, 1 ] 9395 2.257% 2.257% ( 1, 2 ] 188152 45.192% 47.448% ######### ( 2, 3 ] 114919 27.602% 75.051% ###### ( 3, 4 ] 40081 9.627% 84.678% ## ( 4, 6 ] 43452 10.437% 95.114% ## ( 6, 10 ] 9242 2.220% 97.334% ( 10, 15 ] 1878 0.451% 97.785% ( 15, 22 ] 263 0.063% 97.848% ( 22, 34 ] 20 0.005% 97.853% ( 34, 51 ] 27 0.006% 97.860% ( 51, 76 ] 34 0.008% 97.868% ( 76, 110 ] 29 0.007% 97.875% ( 110, 170 ] 407 0.098% 97.973% ( 170, 250 ] 1594 0.383% 98.355% ( 250, 380 ] 1515 0.364% 98.719% ( 380, 580 ] 1754 0.421% 99.141% ( 580, 870 ] 1437 0.345% 99.486% ( 870, 1300 ] 805 0.193% 99.679% ( 1300, 1900 ] 375 0.090% 99.769% ( 1900, 2900 ] 361 0.087% 99.856% ( 2900, 4400 ] 466 0.112% 99.968% ( 4400, 6600 ] 144 0.035% 100.002% ( 6600, 9900 ] 18 0.004% 100.007% ( 9900, 14000 ] 10 0.002% 100.009% ( 14000, 22000 ] 12 0.003% 100.012% ( 22000, 33000 ] 2 0.000% 100.012% ( 33000, 50000 ] 3 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 78950 Average: 18.2970 StdDev: 261.06 Min: 1 Median: 2.3748 Max: 41844 Percentiles: P50: 2.37 P75: 3.39 P99: 14.07 P99.9: 3838.22 P99.99: 6477.38 ------------------------------------------------------ [ 0, 1 ] 256 0.324% 0.324% ( 1, 2 ] 29553 37.433% 37.757% ####### ( 2, 3 ] 25789 32.665% 70.422% ####### ( 3, 4 ] 9278 11.752% 82.174% ## ( 4, 6 ] 10500 13.300% 95.473% ### ( 6, 10 ] 2394 3.032% 98.505% # ( 10, 15 ] 480 0.608% 99.113% ( 15, 22 ] 56 0.071% 99.184% ( 22, 34 ] 7 0.009% 99.193% ( 34, 51 ] 16 0.020% 99.213% ( 51, 76 ] 16 0.020% 99.234% ( 76, 110 ] 4 0.005% 99.239% ( 110, 170 ] 4 0.005% 99.244% ( 170, 250 ] 19 0.024% 99.268% ( 250, 380 ] 44 0.056% 99.324% ( 380, 580 ] 56 0.071% 99.395% ( 580, 870 ] 75 0.095% 99.490% ( 870, 1300 ] 73 0.092% 99.582% ( 1300, 1900 ] 92 0.117% 99.699% ( 1900, 2900 ] 94 0.119% 99.818% ( 2900, 4400 ] 104 0.132% 99.949% ( 4400, 6600 ] 34 0.043% 99.992% ( 6600, 9900 ] 4 0.005% 99.997% ( 9900, 14000 ] 1 0.001% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 450982 Average: 16.9893 StdDev: 245.51 Min: 1 Median: 2.3209 Max: 40683 Percentiles: P50: 2.32 P75: 3.40 P99: 12.91 P99.9: 2219.56 P99.99: 3254.47 ------------------------------------------------------ [ 0, 1 ] 4393 0.974% 0.974% ( 1, 2 ] 177550 39.370% 40.344% ######## ( 2, 3 ] 135686 30.087% 70.431% ###### ( 3, 4 ] 51671 11.457% 81.888% ## ( 4, 6 ] 59994 13.303% 95.191% ### ( 6, 10 ] 14850 3.293% 98.484% # ( 10, 15 ] 4000 0.887% 99.371% ( 15, 22 ] 643 0.143% 99.513% ( 22, 34 ] 71 0.016% 99.529% ( 34, 51 ] 62 0.014% 99.543% ( 51, 76 ] 48 0.011% 99.553% ( 76, 110 ] 21 0.005% 99.558% ( 110, 170 ] 38 0.008% 99.567% ( 170, 250 ] 79 0.018% 99.584% ( 250, 380 ] 121 0.027% 99.611% ( 380, 580 ] 215 0.048% 99.659% ( 580, 870 ] 314 0.070% 99.728% ( 870, 1300 ] 312 0.069% 99.797% ( 1300, 1900 ] 332 0.074% 99.871% ( 1900, 2900 ] 410 0.091% 99.962% ( 2900, 4400 ] 537 0.119% 100.081% ( 4400, 6600 ] 239 0.053% 100.134% ( 6600, 9900 ] 54 0.012% 100.146% ( 9900, 14000 ] 11 0.002% 100.148% ( 14000, 22000 ] 9 0.002% 100.150% ( 22000, 33000 ] 2 0.000% 100.151% ( 33000, 50000 ] 1 0.000% 100.151% ** Level 3 read latency histogram (micros): Count: 1732455 Average: 11.3933 StdDev: 210.75 Min: 1 Median: 2.2747 Max: 56334 Percentiles: P50: 2.27 P75: 3.20 P99: 9.75 P99.9: 580.77 P99.99: 1176.94 ------------------------------------------------------ [ 0, 1 ] 11331 0.654% 0.654% ( 1, 2 ] 705814 40.741% 41.395% ######## ( 2, 3 ] 542655 31.323% 72.718% ###### ( 3, 4 ] 195449 11.282% 83.999% ## ( 4, 6 ] 214889 12.404% 96.403% ## ( 6, 10 ] 47937 2.767% 99.170% # ( 10, 15 ] 9091 0.525% 99.695% ( 15, 22 ] 1214 0.070% 99.765% ( 22, 34 ] 155 0.009% 99.774% ( 34, 51 ] 212 0.012% 99.786% ( 51, 76 ] 253 0.015% 99.801% ( 76, 110 ] 97 0.006% 99.806% ( 110, 170 ] 115 0.007% 99.813% ( 170, 250 ] 169 0.010% 99.823% ( 250, 380 ] 456 0.026% 99.849% ( 380, 580 ] 883 0.051% 99.900% ( 580, 870 ] 960 0.055% 99.955% ( 870, 1300 ] 843 0.049% 100.004% ( 1300, 1900 ] 762 0.044% 100.048% ( 1900, 2900 ] 976 0.056% 100.104% ( 2900, 4400 ] 1141 0.066% 100.170% ( 4400, 6600 ] 408 0.024% 100.194% ( 6600, 9900 ] 108 0.006% 100.200% ( 9900, 14000 ] 30 0.002% 100.202% ( 14000, 22000 ] 33 0.002% 100.204% ( 22000, 33000 ] 11 0.001% 100.204% ( 33000, 50000 ] 7 0.000% 100.205% ( 50000, 75000 ] 1 0.000% 100.205% ** Level 4 read latency histogram (micros): Count: 1192876 Average: 18.8312 StdDev: 265.51 Min: 1 Median: 2.2586 Max: 62886 Percentiles: P50: 2.26 P75: 3.18 P99: 16.14 P99.9: 2038.88 P99.99: 2890.26 ------------------------------------------------------ [ 0, 1 ] 7770 0.651% 0.651% ( 1, 2 ] 492796 41.312% 41.963% ######## ( 2, 3 ] 370771 31.082% 73.045% ###### ( 3, 4 ] 131578 11.030% 84.075% ## ( 4, 6 ] 139258 11.674% 95.750% ## ( 6, 10 ] 32880 2.756% 98.506% # ( 10, 15 ] 5773 0.484% 98.990% ( 15, 22 ] 747 0.063% 99.052% ( 22, 34 ] 86 0.007% 99.060% ( 34, 51 ] 204 0.017% 99.077% ( 51, 76 ] 228 0.019% 99.096% ( 76, 110 ] 74 0.006% 99.102% ( 110, 170 ] 250 0.021% 99.123% ( 170, 250 ] 908 0.076% 99.199% ( 250, 380 ] 1322 0.111% 99.310% ( 380, 580 ] 2157 0.181% 99.491% ( 580, 870 ] 2135 0.179% 99.670% ( 870, 1300 ] 1516 0.127% 99.797% ( 1300, 1900 ] 1055 0.088% 99.885% ( 1900, 2900 ] 1261 0.106% 99.991% ( 2900, 4400 ] 1400 0.117% 100.108% ( 4400, 6600 ] 436 0.037% 100.145% ( 6600, 9900 ] 96 0.008% 100.153% ( 9900, 14000 ] 13 0.001% 100.154% ( 14000, 22000 ] 32 0.003% 100.157% ( 22000, 33000 ] 12 0.001% 100.158% ( 33000, 50000 ] 6 0.001% 100.158% ( 50000, 75000 ] 2 0.000% 100.158% ** Level 5 read latency histogram (micros): Count: 33477 Average: 1229.3490 StdDev: 1910.04 Min: 98 Median: 660.1264 Max: 87394 Percentiles: P50: 660.13 P75: 1413.85 P99: 6445.85 P99.9: 21799.16 P99.99: 49577.79 ------------------------------------------------------ ( 76, 110 ] 22 0.066% 0.066% ( 110, 170 ] 849 2.536% 2.602% # ( 170, 250 ] 3685 11.008% 13.609% ## ( 250, 380 ] 4454 13.305% 26.914% ### ( 380, 580 ] 6100 18.221% 45.135% #### ( 580, 870 ] 5894 17.606% 62.742% #### ( 870, 1300 ] 3670 10.963% 73.704% ## ( 1300, 1900 ] 2286 6.829% 80.533% # ( 1900, 2900 ] 2424 7.241% 87.774% # ( 2900, 4400 ] 2819 8.421% 96.194% ## ( 4400, 6600 ] 1010 3.017% 99.211% # ( 6600, 9900 ] 196 0.585% 99.797% ( 9900, 14000 ] 16 0.048% 99.845% ( 14000, 22000 ] 19 0.057% 99.901% ( 22000, 33000 ] 16 0.048% 99.949% ( 33000, 50000 ] 14 0.042% 99.991% ( 50000, 75000 ] 4 0.012% 100.003% ( 75000, 110000 ] 2 0.006% 100.009% ** DB Stats ** Uptime(secs): 14.6 total, 5.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 135.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.020 H:M:S, 34.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 168.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.281 H:M:S, 21.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/12-11:22:28 ... thread 0: (1000000,3000000) ops and (268702.6,165968.2) ops/second in (3.721587,18.075752) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 2.77 GB 144.8 2.0 0.0 2.0 4.8 2.8 0.0 1.7 74.4 181.4 27.08 16.71 47 0.576 2046K 2197 0.0 0.0 L1 2/2 99.19 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.0 1.0 113.6 113.4 3.61 2.04 1 3.610 416K 505 0.0 0.0 L2 1/0 61.43 MB 0.6 0.3 0.3 0.0 0.3 0.3 0.0 1.0 107.5 107.5 2.89 1.49 1 2.885 315K 0 0.0 0.0 L3 16/0 936.64 MB 0.9 3.8 2.0 1.8 3.7 1.9 0.1 1.9 108.4 106.9 35.57 19.40 17 2.092 1960K 1038 0.0 0.0 L4 161/0 9.52 GB 1.0 10.0 5.4 4.6 9.8 5.2 0.3 1.8 126.7 125.0 80.62 49.65 47 1.715 4445K 2421 0.0 0.0 L5 1188/0 94.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1386/13 108.10 GB 0.0 16.4 8.0 8.4 19.1 10.7 5.9 6.7 112.2 130.3 149.77 89.29 113 1.325 9184K 6161 0.0 0.0 Int 0/0 0.00 KB 0.0 16.4 8.0 8.4 19.1 10.7 5.9 6.7 112.2 130.3 149.77 89.29 113 1.325 9184K 6161 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.4 8.0 8.4 16.2 7.9 0.0 0.0 126.7 125.2 132.69 80.77 73 1.818 9184K 6161 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 169.6 17.08 8.52 40 0.427 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.3 total, 18.1 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.05 GB write, 1067.19 MB/s write, 16.41 GB read, 919.38 MB/s read, 149.8 seconds Interval compaction: 19.05 GB write, 1078.96 MB/s write, 16.41 GB read, 929.51 MB/s read, 149.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 35, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 706792 Average: 19.7443 StdDev: 196.78 Min: 1 Median: 1.7933 Max: 48975 Percentiles: P50: 1.79 P75: 2.73 P99: 341.34 P99.9: 2166.50 P99.99: 4095.24 ------------------------------------------------------ [ 0, 1 ] 70075 9.915% 9.915% ## ( 1, 2 ] 357163 50.533% 60.447% ########## ( 2, 3 ] 140468 19.874% 80.322% #### ( 3, 4 ] 47991 6.790% 87.111% # ( 4, 6 ] 49161 6.956% 94.067% # ( 6, 10 ] 10715 1.516% 95.583% ( 10, 15 ] 2133 0.302% 95.885% ( 15, 22 ] 330 0.047% 95.931% ( 22, 34 ] 56 0.008% 95.939% ( 34, 51 ] 29 0.004% 95.944% ( 51, 76 ] 35 0.005% 95.948% ( 76, 110 ] 141 0.020% 95.968% ( 110, 170 ] 5436 0.769% 96.738% ( 170, 250 ] 13360 1.890% 98.628% ( 250, 380 ] 3746 0.530% 99.158% ( 380, 580 ] 2447 0.346% 99.504% ( 580, 870 ] 1510 0.214% 99.718% ( 870, 1300 ] 814 0.115% 99.833% ( 1300, 1900 ] 380 0.054% 99.887% ( 1900, 2900 ] 361 0.051% 99.938% ( 2900, 4400 ] 466 0.066% 100.004% ( 4400, 6600 ] 144 0.020% 100.024% ( 6600, 9900 ] 18 0.003% 100.026% ( 9900, 14000 ] 10 0.001% 100.028% ( 14000, 22000 ] 12 0.002% 100.030% ( 22000, 33000 ] 2 0.000% 100.030% ( 33000, 50000 ] 3 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 79131 Average: 18.7445 StdDev: 260.96 Min: 1 Median: 2.3783 Max: 41844 Percentiles: P50: 2.38 P75: 3.40 P99: 67.70 P99.9: 3835.61 P99.99: 6476.21 ------------------------------------------------------ [ 0, 1 ] 256 0.324% 0.324% ( 1, 2 ] 29553 37.347% 37.670% ####### ( 2, 3 ] 25789 32.590% 70.261% ####### ( 3, 4 ] 9278 11.725% 81.986% ## ( 4, 6 ] 10500 13.269% 95.255% ### ( 6, 10 ] 2394 3.025% 98.280% # ( 10, 15 ] 480 0.607% 98.887% ( 15, 22 ] 56 0.071% 98.957% ( 22, 34 ] 7 0.009% 98.966% ( 34, 51 ] 16 0.020% 98.986% ( 51, 76 ] 16 0.020% 99.007% ( 76, 110 ] 8 0.010% 99.017% ( 110, 170 ] 49 0.062% 99.079% ( 170, 250 ] 121 0.153% 99.232% ( 250, 380 ] 65 0.082% 99.314% ( 380, 580 ] 63 0.080% 99.393% ( 580, 870 ] 77 0.097% 99.491% ( 870, 1300 ] 73 0.092% 99.583% ( 1300, 1900 ] 92 0.116% 99.699% ( 1900, 2900 ] 94 0.119% 99.818% ( 2900, 4400 ] 104 0.131% 99.949% ( 4400, 6600 ] 34 0.043% 99.992% ( 6600, 9900 ] 4 0.005% 99.997% ( 9900, 14000 ] 1 0.001% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 451224 Average: 17.0934 StdDev: 245.49 Min: 1 Median: 2.3218 Max: 40683 Percentiles: P50: 2.32 P75: 3.40 P99: 13.21 P99.9: 2218.97 P99.99: 3254.41 ------------------------------------------------------ [ 0, 1 ] 4393 0.974% 0.974% ( 1, 2 ] 177550 39.349% 40.322% ######## ( 2, 3 ] 135686 30.071% 70.393% ###### ( 3, 4 ] 51671 11.451% 81.844% ## ( 4, 6 ] 59994 13.296% 95.140% ### ( 6, 10 ] 14850 3.291% 98.431% # ( 10, 15 ] 4000 0.886% 99.317% ( 15, 22 ] 643 0.143% 99.460% ( 22, 34 ] 71 0.016% 99.476% ( 34, 51 ] 62 0.014% 99.489% ( 51, 76 ] 48 0.011% 99.500% ( 76, 110 ] 22 0.005% 99.505% ( 110, 170 ] 105 0.023% 99.528% ( 170, 250 ] 221 0.049% 99.577% ( 250, 380 ] 146 0.032% 99.610% ( 380, 580 ] 220 0.049% 99.658% ( 580, 870 ] 315 0.070% 99.728% ( 870, 1300 ] 313 0.069% 99.797% ( 1300, 1900 ] 332 0.074% 99.871% ( 1900, 2900 ] 410 0.091% 99.962% ( 2900, 4400 ] 537 0.119% 100.081% ( 4400, 6600 ] 239 0.053% 100.134% ( 6600, 9900 ] 54 0.012% 100.146% ( 9900, 14000 ] 11 0.002% 100.148% ( 14000, 22000 ] 9 0.002% 100.150% ( 22000, 33000 ] 2 0.000% 100.151% ( 33000, 50000 ] 1 0.000% 100.151% ** Level 3 read latency histogram (micros): Count: 1737426 Average: 11.4598 StdDev: 210.50 Min: 1 Median: 2.2734 Max: 56334 Percentiles: P50: 2.27 P75: 3.20 P99: 9.82 P99.9: 580.77 P99.99: 1176.84 ------------------------------------------------------ [ 0, 1 ] 11569 0.666% 0.666% ( 1, 2 ] 708570 40.783% 41.449% ######## ( 2, 3 ] 543456 31.279% 72.728% ###### ( 3, 4 ] 195659 11.261% 83.989% ## ( 4, 6 ] 214989 12.374% 96.363% ## ( 6, 10 ] 48011 2.763% 99.127% # ( 10, 15 ] 9096 0.524% 99.650% ( 15, 22 ] 1214 0.070% 99.720% ( 22, 34 ] 155 0.009% 99.729% ( 34, 51 ] 212 0.012% 99.741% ( 51, 76 ] 253 0.015% 99.756% ( 76, 110 ] 105 0.006% 99.762% ( 110, 170 ] 314 0.018% 99.780% ( 170, 250 ] 645 0.037% 99.817% ( 250, 380 ] 536 0.031% 99.848% ( 380, 580 ] 902 0.052% 99.900% ( 580, 870 ] 964 0.055% 99.955% ( 870, 1300 ] 844 0.049% 100.004% ( 1300, 1900 ] 762 0.044% 100.048% ( 1900, 2900 ] 976 0.056% 100.104% ( 2900, 4400 ] 1141 0.066% 100.170% ( 4400, 6600 ] 408 0.023% 100.193% ( 6600, 9900 ] 108 0.006% 100.199% ( 9900, 14000 ] 30 0.002% 100.201% ( 14000, 22000 ] 33 0.002% 100.203% ( 22000, 33000 ] 11 0.001% 100.204% ( 33000, 50000 ] 7 0.000% 100.204% ( 50000, 75000 ] 1 0.000% 100.204% ** Level 4 read latency histogram (micros): Count: 1204012 Average: 19.8809 StdDev: 264.73 Min: 1 Median: 2.2671 Max: 62886 Percentiles: P50: 2.27 P75: 3.22 P99: 226.54 P99.9: 2029.25 P99.99: 2888.58 ------------------------------------------------------ [ 0, 1 ] 7941 0.660% 0.660% ( 1, 2 ] 494850 41.100% 41.760% ######## ( 2, 3 ] 371430 30.849% 72.609% ###### ( 3, 4 ] 131952 10.959% 83.568% ## ( 4, 6 ] 139976 11.626% 95.194% ## ( 6, 10 ] 32992 2.740% 97.934% # ( 10, 15 ] 5798 0.482% 98.416% ( 15, 22 ] 758 0.063% 98.479% ( 22, 34 ] 95 0.008% 98.487% ( 34, 51 ] 204 0.017% 98.504% ( 51, 76 ] 228 0.019% 98.523% ( 76, 110 ] 130 0.011% 98.533% ( 110, 170 ] 2087 0.173% 98.707% ( 170, 250 ] 4996 0.415% 99.122% ( 250, 380 ] 2057 0.171% 99.293% ( 380, 580 ] 2406 0.200% 99.492% ( 580, 870 ] 2173 0.180% 99.673% ( 870, 1300 ] 1517 0.126% 99.799% ( 1300, 1900 ] 1055 0.088% 99.886% ( 1900, 2900 ] 1261 0.105% 99.991% ( 2900, 4400 ] 1400 0.116% 100.107% ( 4400, 6600 ] 436 0.036% 100.144% ( 6600, 9900 ] 96 0.008% 100.152% ( 9900, 14000 ] 13 0.001% 100.153% ( 14000, 22000 ] 32 0.003% 100.155% ( 22000, 33000 ] 12 0.001% 100.156% ( 33000, 50000 ] 6 0.000% 100.157% ( 50000, 75000 ] 2 0.000% 100.157% ** Level 5 read latency histogram (micros): Count: 76311 Average: 656.0186 StdDev: 1363.96 Min: 93 Median: 241.6786 Max: 87394 Percentiles: P50: 241.68 P75: 566.06 P99: 5512.83 P99.9: 9760.07 P99.99: 44376.52 ------------------------------------------------------ ( 76, 110 ] 261 0.342% 0.342% ( 110, 170 ] 12023 15.755% 16.097% ### ( 170, 250 ] 28875 37.839% 53.936% ######## ( 250, 380 ] 9136 11.972% 65.908% ## ( 380, 580 ] 7458 9.773% 75.681% ## ( 580, 870 ] 6063 7.945% 83.626% ## ( 870, 1300 ] 3688 4.833% 88.459% # ( 1300, 1900 ] 2290 3.001% 91.460% # ( 1900, 2900 ] 2424 3.176% 94.636% # ( 2900, 4400 ] 2819 3.694% 98.331% # ( 4400, 6600 ] 1010 1.324% 99.654% ( 6600, 9900 ] 196 0.257% 99.911% ( 9900, 14000 ] 16 0.021% 99.932% ( 14000, 22000 ] 19 0.025% 99.957% ( 22000, 33000 ] 16 0.021% 99.978% ( 33000, 50000 ] 14 0.018% 99.996% ( 50000, 75000 ] 4 0.005% 100.001% ( 75000, 110000 ] 2 0.003% 100.004% ** DB Stats ** Uptime(secs): 18.3 total, 3.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 161.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.020 H:M:S, 27.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 264.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-11:22:34 ... thread 0: (1000000,4000000) ops and (167134.9,166258.3) ops/second in (5.983191,24.058943) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.75 GB 119.6 3.2 0.0 3.2 6.9 3.7 0.0 1.9 94.1 204.3 34.83 24.04 67 0.520 3326K 3426 0.0 0.0 L1 2/2 99.19 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.0 1.0 113.6 113.4 3.61 2.04 1 3.610 416K 505 0.0 0.0 L2 1/0 61.43 MB 0.6 0.3 0.3 0.0 0.3 0.3 0.0 1.0 107.5 107.5 2.89 1.49 1 2.885 315K 0 0.0 0.0 L3 16/0 936.64 MB 0.9 3.8 2.0 1.8 3.7 1.9 0.1 1.9 108.4 106.9 35.57 19.40 17 2.092 1960K 1038 0.0 0.0 L4 161/0 9.52 GB 1.0 10.0 5.4 4.6 9.8 5.2 0.3 1.8 126.7 125.0 80.62 49.65 47 1.715 4445K 2421 0.0 0.0 L5 1188/0 94.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1387/15 109.08 GB 0.0 17.6 8.0 9.6 21.2 11.6 5.9 5.7 114.7 137.8 157.51 96.62 133 1.184 10M 7390 0.0 0.0 Int 0/0 0.00 KB 0.0 17.6 8.0 9.6 21.2 11.6 5.9 5.7 114.7 137.8 157.51 96.62 133 1.184 10M 7390 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.6 8.0 9.6 17.5 7.9 0.0 0.0 131.5 130.0 137.43 85.44 78 1.762 10M 7390 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 191.4 20.08 11.18 55 0.365 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.3 total, 24.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.20 GB write, 894.86 MB/s write, 17.64 GB read, 744.60 MB/s read, 157.5 seconds Interval compaction: 21.20 GB write, 902.27 MB/s write, 17.64 GB read, 750.77 MB/s read, 157.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 35, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1068509 Average: 19.8666 StdDev: 163.70 Min: 0 Median: 1.6930 Max: 48975 Percentiles: P50: 1.69 P75: 2.58 P99: 288.46 P99.9: 1249.92 P99.99: 3299.62 ------------------------------------------------------ [ 0, 1 ] 150517 14.087% 14.087% ### ( 1, 2 ] 553755 51.825% 65.912% ########## ( 2, 3 ] 167694 15.694% 81.606% ### ( 3, 4 ] 59051 5.526% 87.132% # ( 4, 6 ] 59311 5.551% 92.683% # ( 6, 10 ] 12445 1.165% 93.848% ( 10, 15 ] 2612 0.244% 94.092% ( 15, 22 ] 442 0.041% 94.134% ( 22, 34 ] 96 0.009% 94.143% ( 34, 51 ] 38 0.004% 94.146% ( 51, 76 ] 36 0.003% 94.150% ( 76, 110 ] 468 0.044% 94.193% ( 110, 170 ] 16640 1.557% 95.751% ( 170, 250 ] 32969 3.086% 98.836% # ( 250, 380 ] 5922 0.554% 99.390% ( 380, 580 ] 3137 0.294% 99.684% ( 580, 870 ] 1585 0.148% 99.832% ( 870, 1300 ] 820 0.077% 99.909% ( 1300, 1900 ] 381 0.036% 99.945% ( 1900, 2900 ] 361 0.034% 99.979% ( 2900, 4400 ] 466 0.044% 100.022% ( 4400, 6600 ] 144 0.013% 100.036% ( 6600, 9900 ] 18 0.002% 100.037% ( 9900, 14000 ] 10 0.001% 100.038% ( 14000, 22000 ] 12 0.001% 100.039% ( 22000, 33000 ] 2 0.000% 100.040% ( 33000, 50000 ] 3 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 79432 Average: 19.4008 StdDev: 260.72 Min: 1 Median: 2.3842 Max: 41844 Percentiles: P50: 2.38 P75: 3.43 P99: 206.03 P99.9: 3831.27 P99.99: 6474.26 ------------------------------------------------------ [ 0, 1 ] 256 0.322% 0.322% ( 1, 2 ] 29553 37.205% 37.528% ####### ( 2, 3 ] 25789 32.467% 69.994% ###### ( 3, 4 ] 9278 11.680% 81.675% ## ( 4, 6 ] 10500 13.219% 94.894% ### ( 6, 10 ] 2394 3.014% 97.908% # ( 10, 15 ] 480 0.604% 98.512% ( 15, 22 ] 56 0.071% 98.582% ( 22, 34 ] 7 0.009% 98.591% ( 34, 51 ] 16 0.020% 98.611% ( 51, 76 ] 16 0.020% 98.632% ( 76, 110 ] 13 0.016% 98.648% ( 110, 170 ] 145 0.183% 98.830% ( 170, 250 ] 299 0.376% 99.207% ( 250, 380 ] 81 0.102% 99.309% ( 380, 580 ] 68 0.086% 99.394% ( 580, 870 ] 77 0.097% 99.491% ( 870, 1300 ] 74 0.093% 99.585% ( 1300, 1900 ] 92 0.116% 99.700% ( 1900, 2900 ] 94 0.118% 99.819% ( 2900, 4400 ] 104 0.131% 99.950% ( 4400, 6600 ] 34 0.043% 99.992% ( 6600, 9900 ] 4 0.005% 99.997% ( 9900, 14000 ] 1 0.001% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 451655 Average: 17.2618 StdDev: 245.45 Min: 1 Median: 2.3234 Max: 40683 Percentiles: P50: 2.32 P75: 3.41 P99: 13.74 P99.9: 2217.91 P99.99: 3254.29 ------------------------------------------------------ [ 0, 1 ] 4393 0.973% 0.973% ( 1, 2 ] 177550 39.311% 40.284% ######## ( 2, 3 ] 135686 30.042% 70.326% ###### ( 3, 4 ] 51671 11.440% 81.766% ## ( 4, 6 ] 59994 13.283% 95.049% ### ( 6, 10 ] 14850 3.288% 98.337% # ( 10, 15 ] 4000 0.886% 99.223% ( 15, 22 ] 643 0.142% 99.365% ( 22, 34 ] 71 0.016% 99.381% ( 34, 51 ] 62 0.014% 99.394% ( 51, 76 ] 48 0.011% 99.405% ( 76, 110 ] 27 0.006% 99.411% ( 110, 170 ] 262 0.058% 99.469% ( 170, 250 ] 449 0.099% 99.568% ( 250, 380 ] 178 0.039% 99.608% ( 380, 580 ] 227 0.050% 99.658% ( 580, 870 ] 316 0.070% 99.728% ( 870, 1300 ] 313 0.069% 99.797% ( 1300, 1900 ] 333 0.074% 99.871% ( 1900, 2900 ] 410 0.091% 99.962% ( 2900, 4400 ] 537 0.119% 100.081% ( 4400, 6600 ] 239 0.053% 100.134% ( 6600, 9900 ] 54 0.012% 100.146% ( 9900, 14000 ] 11 0.002% 100.148% ( 14000, 22000 ] 9 0.002% 100.150% ( 22000, 33000 ] 2 0.000% 100.151% ( 33000, 50000 ] 1 0.000% 100.151% ** Level 3 read latency histogram (micros): Count: 1738837 Average: 11.6056 StdDev: 210.48 Min: 1 Median: 2.2747 Max: 56334 Percentiles: P50: 2.27 P75: 3.21 P99: 9.93 P99.9: 581.25 P99.99: 1176.77 ------------------------------------------------------ [ 0, 1 ] 11569 0.665% 0.665% ( 1, 2 ] 708570 40.750% 41.415% ######## ( 2, 3 ] 543456 31.254% 72.669% ###### ( 3, 4 ] 195659 11.252% 83.921% ## ( 4, 6 ] 214989 12.364% 96.285% ## ( 6, 10 ] 48011 2.761% 99.046% # ( 10, 15 ] 9096 0.523% 99.569% ( 15, 22 ] 1214 0.070% 99.639% ( 22, 34 ] 155 0.009% 99.648% ( 34, 51 ] 212 0.012% 99.660% ( 51, 76 ] 253 0.015% 99.675% ( 76, 110 ] 123 0.007% 99.682% ( 110, 170 ] 788 0.045% 99.727% ( 170, 250 ] 1446 0.083% 99.810% ( 250, 380 ] 628 0.036% 99.847% ( 380, 580 ] 925 0.053% 99.900% ( 580, 870 ] 967 0.056% 99.955% ( 870, 1300 ] 844 0.049% 100.004% ( 1300, 1900 ] 762 0.044% 100.048% ( 1900, 2900 ] 976 0.056% 100.104% ( 2900, 4400 ] 1141 0.066% 100.169% ( 4400, 6600 ] 408 0.023% 100.193% ( 6600, 9900 ] 108 0.006% 100.199% ( 9900, 14000 ] 30 0.002% 100.201% ( 14000, 22000 ] 33 0.002% 100.203% ( 22000, 33000 ] 11 0.001% 100.203% ( 33000, 50000 ] 7 0.000% 100.204% ( 50000, 75000 ] 1 0.000% 100.204% ** Level 4 read latency histogram (micros): Count: 1217798 Average: 21.6795 StdDev: 263.89 Min: 1 Median: 2.2856 Max: 62886 Percentiles: P50: 2.29 P75: 3.30 P99: 246.34 P99.9: 2017.53 P99.99: 2886.69 ------------------------------------------------------ [ 0, 1 ] 7941 0.652% 0.652% ( 1, 2 ] 494859 40.636% 41.288% ######## ( 2, 3 ] 371463 30.503% 71.790% ###### ( 3, 4 ] 132151 10.852% 82.642% ## ( 4, 6 ] 140626 11.548% 94.190% ## ( 6, 10 ] 33044 2.713% 96.903% # ( 10, 15 ] 5824 0.478% 97.381% ( 15, 22 ] 760 0.062% 97.444% ( 22, 34 ] 95 0.008% 97.452% ( 34, 51 ] 205 0.017% 97.468% ( 51, 76 ] 228 0.019% 97.487% ( 76, 110 ] 241 0.020% 97.507% ( 110, 170 ] 6519 0.535% 98.042% ( 170, 250 ] 12224 1.004% 99.046% ( 250, 380 ] 2830 0.232% 99.278% ( 380, 580 ] 2645 0.217% 99.496% ( 580, 870 ] 2202 0.181% 99.676% ( 870, 1300 ] 1519 0.125% 99.801% ( 1300, 1900 ] 1056 0.087% 99.888% ( 1900, 2900 ] 1261 0.104% 99.991% ( 2900, 4400 ] 1400 0.115% 100.106% ( 4400, 6600 ] 436 0.036% 100.142% ( 6600, 9900 ] 96 0.008% 100.150% ( 9900, 14000 ] 13 0.001% 100.151% ( 14000, 22000 ] 32 0.003% 100.154% ( 22000, 33000 ] 12 0.001% 100.155% ( 33000, 50000 ] 6 0.000% 100.155% ( 50000, 75000 ] 2 0.000% 100.155% ** Level 5 read latency histogram (micros): Count: 150833 Average: 427.2287 StdDev: 998.32 Min: 90 Median: 212.0233 Max: 87394 Percentiles: P50: 212.02 P75: 285.64 P99: 4275.31 P99.9: 8505.36 P99.99: 35327.42 ------------------------------------------------------ ( 76, 110 ] 998 0.662% 0.662% ( 110, 170 ] 36898 24.463% 25.124% ##### ( 170, 250 ] 71428 47.356% 72.480% ######### ( 250, 380 ] 13865 9.192% 81.672% ## ( 380, 580 ] 8882 5.889% 87.561% # ( 580, 870 ] 6258 4.149% 91.710% # ( 870, 1300 ] 3697 2.451% 94.161% ( 1300, 1900 ] 2290 1.518% 95.679% ( 1900, 2900 ] 2424 1.607% 97.286% ( 2900, 4400 ] 2819 1.869% 99.155% ( 4400, 6600 ] 1010 0.670% 99.825% ( 6600, 9900 ] 196 0.130% 99.955% ( 9900, 14000 ] 16 0.011% 99.966% ( 14000, 22000 ] 19 0.013% 99.978% ( 22000, 33000 ] 16 0.011% 99.989% ( 33000, 50000 ] 14 0.009% 99.998% ( 50000, 75000 ] 4 0.003% 100.001% ( 75000, 110000 ] 2 0.001% 100.002% ** DB Stats ** Uptime(secs): 24.3 total, 6.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 162.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.111 H:M:S, 29.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 164.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.091 H:M:S, 34.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-11:22:43 ... thread 0: (1000000,5000000) ops and (106384.6,149437.5) ops/second in (9.399860,33.458803) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 4.72 GB 263.4 5.7 0.0 5.7 10.4 4.7 0.0 2.2 121.6 223.1 47.66 36.37 88 0.542 5883K 14K 0.0 0.0 L1 2/2 99.19 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.0 1.0 113.6 113.4 3.61 2.04 1 3.610 416K 505 0.0 0.0 L2 1/0 61.43 MB 0.6 0.3 0.3 0.0 0.3 0.3 0.0 1.0 107.5 107.5 2.89 1.49 1 2.885 315K 0 0.0 0.0 L3 16/0 936.64 MB 0.9 3.8 2.0 1.8 3.7 1.9 0.1 1.9 108.4 106.9 35.57 19.40 17 2.092 1960K 1038 0.0 0.0 L4 161/0 9.52 GB 1.0 10.0 5.4 4.6 9.8 5.2 0.3 1.8 126.7 125.0 80.62 49.65 47 1.715 4445K 2421 0.0 0.0 L5 1188/0 94.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1386/14 110.05 GB 0.0 20.1 8.0 12.1 24.6 12.6 5.9 5.2 120.8 148.1 170.34 108.95 154 1.106 13M 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.1 8.0 12.1 24.6 12.6 5.9 5.2 120.8 148.1 170.34 108.95 154 1.106 13M 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.1 8.0 12.1 19.9 7.8 0.0 0.0 140.0 138.6 147.04 94.90 83 1.772 13M 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 208.1 23.31 14.05 71 0.328 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.7 total, 33.5 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.64 GB write, 749.43 MB/s write, 20.10 GB read, 611.50 MB/s read, 170.3 seconds Interval compaction: 24.64 GB write, 753.89 MB/s write, 20.10 GB read, 615.14 MB/s read, 170.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 35, interval: 52 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1767063 Average: 19.0323 StdDev: 132.02 Min: 0 Median: 1.6217 Max: 48975 Percentiles: P50: 1.62 P75: 2.37 P99: 248.78 P99.9: 785.09 P99.99: 1695.24 ------------------------------------------------------ [ 0, 1 ] 297235 16.821% 16.821% ### ( 1, 2 ] 943025 53.367% 70.188% ########### ( 2, 3 ] 229138 12.967% 83.155% ### ( 3, 4 ] 81546 4.615% 87.770% # ( 4, 6 ] 77018 4.359% 92.128% # ( 6, 10 ] 15499 0.877% 93.005% ( 10, 15 ] 3275 0.185% 93.191% ( 15, 22 ] 650 0.037% 93.227% ( 22, 34 ] 174 0.010% 93.237% ( 34, 51 ] 49 0.003% 93.240% ( 51, 76 ] 37 0.002% 93.242% ( 76, 110 ] 980 0.055% 93.298% ( 110, 170 ] 35532 2.011% 95.308% ( 170, 250 ] 66242 3.749% 99.057% # ( 250, 380 ] 9470 0.536% 99.593% ( 380, 580 ] 4207 0.238% 99.831% ( 580, 870 ] 1725 0.098% 99.929% ( 870, 1300 ] 833 0.047% 99.976% ( 1300, 1900 ] 383 0.022% 99.997% ( 1900, 2900 ] 361 0.020% 100.018% ( 2900, 4400 ] 466 0.026% 100.044% ( 4400, 6600 ] 145 0.008% 100.052% ( 6600, 9900 ] 18 0.001% 100.053% ( 9900, 14000 ] 10 0.001% 100.054% ( 14000, 22000 ] 12 0.001% 100.055% ( 22000, 33000 ] 2 0.000% 100.055% ( 33000, 50000 ] 3 0.000% 100.055% ** Level 1 read latency histogram (micros): Count: 79896 Average: 20.4194 StdDev: 260.35 Min: 1 Median: 2.3932 Max: 41844 Percentiles: P50: 2.39 P75: 3.47 P99: 231.61 P99.9: 3824.58 P99.99: 6471.26 ------------------------------------------------------ [ 0, 1 ] 256 0.320% 0.320% ( 1, 2 ] 29553 36.989% 37.310% ####### ( 2, 3 ] 25789 32.278% 69.588% ###### ( 3, 4 ] 9278 11.613% 81.201% ## ( 4, 6 ] 10500 13.142% 94.343% ### ( 6, 10 ] 2394 2.996% 97.339% # ( 10, 15 ] 480 0.601% 97.940% ( 15, 22 ] 56 0.070% 98.010% ( 22, 34 ] 7 0.009% 98.019% ( 34, 51 ] 16 0.020% 98.039% ( 51, 76 ] 16 0.020% 98.059% ( 76, 110 ] 18 0.023% 98.081% ( 110, 170 ] 302 0.378% 98.459% ( 170, 250 ] 561 0.702% 99.161% ( 250, 380 ] 109 0.136% 99.298% ( 380, 580 ] 78 0.098% 99.395% ( 580, 870 ] 79 0.099% 99.494% ( 870, 1300 ] 74 0.093% 99.587% ( 1300, 1900 ] 92 0.115% 99.702% ( 1900, 2900 ] 94 0.118% 99.820% ( 2900, 4400 ] 104 0.130% 99.950% ( 4400, 6600 ] 34 0.043% 99.992% ( 6600, 9900 ] 4 0.005% 99.997% ( 9900, 14000 ] 1 0.001% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 452285 Average: 17.5038 StdDev: 245.38 Min: 1 Median: 2.3257 Max: 40683 Percentiles: P50: 2.33 P75: 3.42 P99: 14.52 P99.9: 2216.38 P99.99: 3254.11 ------------------------------------------------------ [ 0, 1 ] 4393 0.971% 0.971% ( 1, 2 ] 177550 39.256% 40.228% ######## ( 2, 3 ] 135686 30.000% 70.228% ###### ( 3, 4 ] 51671 11.424% 81.652% ## ( 4, 6 ] 59994 13.265% 94.917% ### ( 6, 10 ] 14850 3.283% 98.200% # ( 10, 15 ] 4000 0.884% 99.084% ( 15, 22 ] 643 0.142% 99.227% ( 22, 34 ] 71 0.016% 99.242% ( 34, 51 ] 62 0.014% 99.256% ( 51, 76 ] 48 0.011% 99.267% ( 76, 110 ] 33 0.007% 99.274% ( 110, 170 ] 478 0.106% 99.380% ( 170, 250 ] 811 0.179% 99.559% ( 250, 380 ] 208 0.046% 99.605% ( 380, 580 ] 242 0.054% 99.658% ( 580, 870 ] 317 0.070% 99.728% ( 870, 1300 ] 313 0.069% 99.798% ( 1300, 1900 ] 333 0.074% 99.871% ( 1900, 2900 ] 410 0.091% 99.962% ( 2900, 4400 ] 537 0.119% 100.081% ( 4400, 6600 ] 239 0.053% 100.134% ( 6600, 9900 ] 54 0.012% 100.145% ( 9900, 14000 ] 11 0.002% 100.148% ( 14000, 22000 ] 9 0.002% 100.150% ( 22000, 33000 ] 2 0.000% 100.150% ( 33000, 50000 ] 1 0.000% 100.151% ** Level 3 read latency histogram (micros): Count: 1740981 Average: 11.8311 StdDev: 210.46 Min: 1 Median: 2.2767 Max: 56334 Percentiles: P50: 2.28 P75: 3.22 P99: 10.72 P99.9: 583.57 P99.99: 1176.66 ------------------------------------------------------ [ 0, 1 ] 11569 0.665% 0.665% ( 1, 2 ] 708570 40.699% 41.364% ######## ( 2, 3 ] 543456 31.216% 72.579% ###### ( 3, 4 ] 195659 11.238% 83.818% ## ( 4, 6 ] 214989 12.349% 96.167% ## ( 6, 10 ] 48011 2.758% 98.924% # ( 10, 15 ] 9096 0.522% 99.447% ( 15, 22 ] 1214 0.070% 99.517% ( 22, 34 ] 155 0.009% 99.525% ( 34, 51 ] 212 0.012% 99.538% ( 51, 76 ] 253 0.015% 99.552% ( 76, 110 ] 138 0.008% 99.560% ( 110, 170 ] 1484 0.085% 99.645% ( 170, 250 ] 2692 0.155% 99.800% ( 250, 380 ] 766 0.044% 99.844% ( 380, 580 ] 964 0.055% 99.899% ( 580, 870 ] 977 0.056% 99.955% ( 870, 1300 ] 844 0.048% 100.004% ( 1300, 1900 ] 762 0.044% 100.048% ( 1900, 2900 ] 976 0.056% 100.104% ( 2900, 4400 ] 1141 0.066% 100.169% ( 4400, 6600 ] 408 0.023% 100.193% ( 6600, 9900 ] 108 0.006% 100.199% ( 9900, 14000 ] 30 0.002% 100.201% ( 14000, 22000 ] 33 0.002% 100.203% ( 22000, 33000 ] 11 0.001% 100.203% ( 33000, 50000 ] 7 0.000% 100.204% ( 50000, 75000 ] 1 0.000% 100.204% ** Level 4 read latency histogram (micros): Count: 1239079 Average: 24.5382 StdDev: 262.63 Min: 1 Median: 2.3143 Max: 62886 Percentiles: P50: 2.31 P75: 3.42 P99: 276.99 P99.9: 2000.65 P99.99: 2885.01 ------------------------------------------------------ [ 0, 1 ] 7941 0.641% 0.641% ( 1, 2 ] 494860 39.938% 40.579% ######## ( 2, 3 ] 371468 29.979% 70.558% ###### ( 3, 4 ] 132233 10.672% 81.230% ## ( 4, 6 ] 140861 11.368% 92.598% ## ( 6, 10 ] 33068 2.669% 95.267% # ( 10, 15 ] 5831 0.471% 95.737% ( 15, 22 ] 763 0.062% 95.799% ( 22, 34 ] 95 0.008% 95.807% ( 34, 51 ] 206 0.017% 95.823% ( 51, 76 ] 228 0.018% 95.842% ( 76, 110 ] 465 0.038% 95.879% ( 110, 170 ] 13632 1.100% 96.979% ( 170, 250 ] 24201 1.953% 98.933% ( 250, 380 ] 4027 0.325% 99.258% ( 380, 580 ] 3010 0.243% 99.500% ( 580, 870 ] 2242 0.181% 99.681% ( 870, 1300 ] 1526 0.123% 99.805% ( 1300, 1900 ] 1056 0.085% 99.890% ( 1900, 2900 ] 1261 0.102% 99.992% ( 2900, 4400 ] 1400 0.113% 100.105% ( 4400, 6600 ] 436 0.035% 100.140% ( 6600, 9900 ] 96 0.008% 100.147% ( 9900, 14000 ] 13 0.001% 100.148% ( 14000, 22000 ] 32 0.003% 100.151% ( 22000, 33000 ] 12 0.001% 100.152% ( 33000, 50000 ] 6 0.000% 100.153% ( 50000, 75000 ] 2 0.000% 100.153% ** Level 5 read latency histogram (micros): Count: 265156 Average: 325.7822 StdDev: 762.91 Min: 90 Median: 202.0981 Max: 87394 Percentiles: P50: 202.10 P75: 240.89 P99: 3666.46 P99.9: 6595.30 P99.99: 25770.52 ------------------------------------------------------ ( 76, 110 ] 2056 0.775% 0.775% ( 110, 170 ] 75678 28.541% 29.316% ###### ( 170, 250 ] 136691 51.551% 80.867% ########## ( 250, 380 ] 20735 7.820% 88.687% ## ( 380, 580 ] 10954 4.131% 92.819% # ( 580, 870 ] 6520 2.459% 95.277% ( 870, 1300 ] 3716 1.401% 96.679% ( 1300, 1900 ] 2290 0.864% 97.543% ( 1900, 2900 ] 2424 0.914% 98.457% ( 2900, 4400 ] 2819 1.063% 99.520% ( 4400, 6600 ] 1010 0.381% 99.901% ( 6600, 9900 ] 196 0.074% 99.975% ( 9900, 14000 ] 16 0.006% 99.981% ( 14000, 22000 ] 19 0.007% 99.988% ( 22000, 33000 ] 16 0.006% 99.994% ( 33000, 50000 ] 14 0.005% 99.999% ( 50000, 75000 ] 4 0.002% 100.001% ( 75000, 110000 ] 2 0.001% 100.002% ** DB Stats ** Uptime(secs): 33.7 total, 9.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 146.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.338 H:M:S, 36.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 104.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.227 H:M:S, 55.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 311.542 micros/op 12823 ops/sec 60.202 seconds 771996 operations; 12.4 MB/s (192999 of 192999 found) Microseconds per read: Count: 771996 Average: 311.5465 StdDev: 984.34 Min: 3 Median: 222.6866 Max: 116742 Percentiles: P50: 222.69 P75: 284.99 P99: 1299.37 P99.9: 15776.12 P99.99: 37565.81 ------------------------------------------------------ ( 2, 3 ] 1 0.000% 0.000% ( 3, 4 ] 4 0.001% 0.001% ( 4, 6 ] 68 0.009% 0.009% ( 6, 10 ] 209 0.027% 0.037% ( 10, 15 ] 144 0.019% 0.055% ( 15, 22 ] 477 0.062% 0.117% ( 22, 34 ] 9583 1.241% 1.358% ( 34, 51 ] 3955 0.512% 1.871% ( 51, 76 ] 689 0.089% 1.960% ( 76, 110 ] 123 0.016% 1.976% ( 110, 170 ] 62537 8.101% 10.076% ## ( 170, 250 ] 467987 60.620% 70.697% ############ ( 250, 380 ] 123436 15.989% 86.686% ### ( 380, 580 ] 74054 9.593% 96.279% ## ( 580, 870 ] 16271 2.108% 98.386% ( 870, 1300 ] 4745 0.615% 99.001% ( 1300, 1900 ] 1886 0.244% 99.245% ( 1900, 2900 ] 1464 0.190% 99.435% ( 2900, 4400 ] 2013 0.261% 99.696% ( 4400, 6600 ] 799 0.103% 99.799% ( 6600, 9900 ] 313 0.041% 99.840% ( 9900, 14000 ] 351 0.045% 99.885% ( 14000, 22000 ] 518 0.067% 99.952% ( 22000, 33000 ] 273 0.035% 99.988% ( 33000, 50000 ] 70 0.009% 99.997% ( 50000, 75000 ] 15 0.002% 99.999% ( 75000, 110000 ] 8 0.001% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 14098734 rocksdb.bloom.filter.full.positive COUNT : 909080 rocksdb.bloom.filter.full.true.positive COUNT : 771598 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 398 rocksdb.memtable.miss COUNT : 771598 rocksdb.l0.hit COUNT : 33729 rocksdb.l1.hit COUNT : 732 rocksdb.l2andup.hit COUNT : 737137 rocksdb.compaction.key.drop.new COUNT : 219850 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5344291 rocksdb.number.keys.read COUNT : 771996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5515308312 rocksdb.bytes.read COUNT : 771996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1690 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 36695677 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 24041675094 rocksdb.compact.write.bytes COUNT : 23814773103 rocksdb.flush.write.bytes COUNT : 5482760448 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 24 rocksdb.number.superversion_acquires COUNT : 1093 rocksdb.number.superversion_releases COUNT : 1048 rocksdb.number.superversion_cleanups COUNT : 269 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 159 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5438489600 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2067456 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27750316620 rocksdb.non.last.level.read.count COUNT : 6561272 rocksdb.block.checksum.compute.count COUNT : 6742258 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 222.055571 P95 : 552.709852 P99 : 1298.731177 P100 : 116740.000000 COUNT : 771996 SUM : 239624562 rocksdb.db.write.micros P50 : 1.648126 P95 : 5.522997 P99 : 13.391160 P100 : 1049361.000000 COUNT : 5344291 SUM : 52541253 rocksdb.compaction.times.micros P50 : 1647222.222222 P95 : 3250000.000000 P99 : 5565000.000000 P100 : 5612132.000000 COUNT : 85 SUM : 152047281 rocksdb.compaction.times.cpu_micros P50 : 1094761.904762 P95 : 2337500.000000 P99 : 4630000.000000 P100 : 5535389.000000 COUNT : 85 SUM : 99827737 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 743.709677 P95 : 5786.000000 P99 : 8629.500000 P100 : 8784.000000 COUNT : 77 SUM : 113631 rocksdb.compaction.outfile.sync.micros P50 : 3847.368421 P95 : 9594.146341 P99 : 19973.333333 P100 : 46593.000000 COUNT : 276 SUM : 1239342 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 232.400000 P95 : 4356.250000 P99 : 7843.000000 P100 : 7879.000000 COUNT : 187 SUM : 174059 rocksdb.table.open.io.micros P50 : 8943.150685 P95 : 20907.894737 P99 : 30444.117647 P100 : 108460.000000 COUNT : 1690 SUM : 16515991 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.280859 P95 : 12.385456 P99 : 233.787554 P100 : 62890.000000 COUNT : 5822348 SUM : 107706911 rocksdb.read.block.get.micros P50 : 189.308928 P95 : 354.634453 P99 : 1309.232198 P100 : 87461.000000 COUNT : 918221 SUM : 200308549 rocksdb.write.raw.block.micros P50 : 0.550259 P95 : 1.629596 P99 : 4.577608 P100 : 82556.000000 COUNT : 7096052 SUM : 26513379 rocksdb.numfiles.in.singlecompaction P50 : 3.081395 P95 : 5.741667 P99 : 8.890000 P100 : 9.000000 COUNT : 111 SUM : 390 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.582914 P95 : 1216.695655 P99 : 2547.771302 P100 : 1049174.000000 COUNT : 176469 SUM : 36718116 rocksdb.sst.read.micros P50 : 2.250388 P95 : 218.076845 P99 : 367.496620 P100 : 87394.000000 COUNT : 6561310 SUM : 290445666 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 771996 SUM : 771996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5344291 SUM : 5515308312 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 226000.000000 P95 : 990333.333333 P99 : 1330650.000000 P100 : 1330650.000000 COUNT : 77 SUM : 24573468 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 305 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0