[2024-10-14 22:10:36.036645] Starting SPDK v25.01-pre git sha1 dc3fcfb2b / DPDK 24.03.0 initialization... [2024-10-14 22:10:36.036951] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3869774 ] Set seed to 1728936636029479 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-10-14 22:10:36.178923] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-10-14 22:10:36.285941] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-10-14 22:10:36.285987] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3869774' to capture a snapshot of events at runtime. [2024-10-14 22:10:36.286001] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-10-14 22:10:36.286015] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-10-14 22:10:36.286025] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3869774 for offline analysis/debug. [2024-10-14 22:10:36.287334] reactor.c:1022:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Oct 14 22:10:39 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/10/14-22:10:45 ... thread 0: (1000000,1000000) ops and (168011.5,168011.5) ops/second in (5.951974,5.951974) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 1.07 GB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 162.9 5.40 2.56 11 0.491 0 0 0.0 0.0 L1 8/8 1001.66 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/1 86.14 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 23/3 1.17 GB 1.0 2.3 1.6 0.7 2.2 1.5 0.0 1.4 136.2 134.1 17.14 11.44 12 1.428 1323K 6147 0.0 0.0 L4 140/8 10.10 GB 1.0 2.6 1.2 1.4 2.4 1.0 0.5 2.0 136.2 123.8 19.86 12.72 12 1.655 588K 439 0.0 0.0 L5 132/0 10.64 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 319/34 24.05 GB 0.0 4.9 2.8 2.1 5.5 3.4 1.5 6.4 118.9 132.9 42.40 26.72 35 1.211 1911K 6586 0.0 0.0 Int 0/0 0.00 KB 0.0 4.9 2.8 2.1 5.5 3.4 1.5 6.4 118.9 132.9 42.40 26.72 35 1.211 1911K 6586 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.9 2.8 2.1 4.6 2.5 0.0 0.0 136.2 128.5 37.00 24.16 24 1.541 1911K 6586 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 162.9 5.40 2.56 11 0.491 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 6.0 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.50 GB write, 933.28 MB/s write, 4.92 GB read, 834.51 MB/s read, 42.4 seconds Interval compaction: 5.50 GB write, 946.35 MB/s write, 4.92 GB read, 846.20 MB/s read, 42.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 19497 Average: 415.8181 StdDev: 1173.71 Min: 1 Median: 9.9359 Max: 48465 Percentiles: P50: 9.94 P75: 511.36 P99: 4159.41 P99.9: 8680.87 P99.99: 31694.16 ------------------------------------------------------ [ 0, 1 ] 281 1.441% 1.441% ( 1, 2 ] 4818 24.711% 26.153% ##### ( 2, 3 ] 2869 14.715% 40.868% ### ( 3, 4 ] 1033 5.298% 46.166% # ( 4, 6 ] 595 3.052% 49.218% # ( 6, 10 ] 156 0.800% 50.018% ( 10, 15 ] 32 0.164% 50.182% ( 15, 22 ] 7 0.036% 50.218% ( 34, 51 ] 1 0.005% 50.223% ( 76, 110 ] 3 0.015% 50.238% ( 110, 170 ] 101 0.518% 50.757% ( 170, 250 ] 751 3.852% 54.608% # ( 250, 380 ] 2005 10.284% 64.892% ## ( 380, 580 ] 3002 15.397% 80.289% ### ( 580, 870 ] 2111 10.827% 91.117% ## ( 870, 1300 ] 676 3.467% 94.584% # ( 1300, 1900 ] 178 0.913% 95.497% ( 1900, 2900 ] 323 1.657% 97.153% ( 2900, 4400 ] 430 2.205% 99.359% ( 4400, 6600 ] 92 0.472% 99.831% ( 6600, 9900 ] 23 0.118% 99.949% ( 9900, 14000 ] 2 0.010% 99.959% ( 22000, 33000 ] 8 0.041% 100.000% ( 33000, 50000 ] 5 0.026% 100.026% ** Level 1 read latency histogram (micros): Count: 198592 Average: 13.5264 StdDev: 194.84 Min: 1 Median: 2.2690 Max: 34332 Percentiles: P50: 2.27 P75: 3.29 P99: 68.28 P99.9: 2513.13 P99.99: 6070.97 ------------------------------------------------------ [ 0, 1 ] 1787 0.900% 0.900% ( 1, 2 ] 81604 41.091% 41.991% ######## ( 2, 3 ] 59135 29.777% 71.768% ###### ( 3, 4 ] 21958 11.057% 82.825% ## ( 4, 6 ] 24220 12.196% 95.021% ## ( 6, 10 ] 6154 3.099% 98.120% # ( 10, 15 ] 1350 0.680% 98.800% ( 15, 22 ] 200 0.101% 98.900% ( 22, 34 ] 75 0.038% 98.938% ( 34, 51 ] 83 0.042% 98.980% ( 51, 76 ] 58 0.029% 99.009% ( 76, 110 ] 14 0.007% 99.016% ( 110, 170 ] 23 0.012% 99.028% ( 170, 250 ] 129 0.065% 99.093% ( 250, 380 ] 336 0.169% 99.262% ( 380, 580 ] 498 0.251% 99.513% ( 580, 870 ] 424 0.214% 99.726% ( 870, 1300 ] 196 0.099% 99.825% ( 1300, 1900 ] 93 0.047% 99.872% ( 1900, 2900 ] 92 0.046% 99.918% ( 2900, 4400 ] 112 0.056% 99.974% ( 4400, 6600 ] 41 0.021% 99.995% ( 6600, 9900 ] 6 0.003% 99.998% ( 9900, 14000 ] 4 0.002% 100.000% ( 14000, 22000 ] 1 0.001% 100.001% ( 22000, 33000 ] 2 0.001% 100.002% ( 33000, 50000 ] 1 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 290204 Average: 9.9958 StdDev: 194.74 Min: 1 Median: 2.2515 Max: 35906 Percentiles: P50: 2.25 P75: 3.24 P99: 12.38 P99.9: 788.39 P99.99: 1519.53 ------------------------------------------------------ [ 0, 1 ] 2988 1.030% 1.030% ( 1, 2 ] 120396 41.487% 42.516% ######## ( 2, 3 ] 86353 29.756% 72.272% ###### ( 3, 4 ] 32854 11.321% 83.593% ## ( 4, 6 ] 34919 12.033% 95.626% ## ( 6, 10 ] 8738 3.011% 98.637% # ( 10, 15 ] 2214 0.763% 99.400% ( 15, 22 ] 355 0.122% 99.522% ( 22, 34 ] 70 0.024% 99.546% ( 34, 51 ] 102 0.035% 99.581% ( 51, 76 ] 58 0.020% 99.601% ( 76, 110 ] 15 0.005% 99.606% ( 110, 170 ] 19 0.007% 99.613% ( 170, 250 ] 86 0.030% 99.643% ( 250, 380 ] 209 0.072% 99.715% ( 380, 580 ] 333 0.115% 99.829% ( 580, 870 ] 285 0.098% 99.928% ( 870, 1300 ] 140 0.048% 99.976% ( 1300, 1900 ] 112 0.039% 100.014% ( 1900, 2900 ] 109 0.038% 100.052% ( 2900, 4400 ] 107 0.037% 100.089% ( 4400, 6600 ] 48 0.017% 100.105% ( 6600, 9900 ] 8 0.003% 100.108% ( 9900, 14000 ] 1 0.000% 100.109% ( 14000, 22000 ] 3 0.001% 100.110% ( 22000, 33000 ] 5 0.002% 100.111% ( 33000, 50000 ] 1 0.000% 100.112% ** Level 3 read latency histogram (micros): Count: 478291 Average: 13.9571 StdDev: 257.30 Min: 1 Median: 2.2949 Max: 52157 Percentiles: P50: 2.29 P75: 3.25 P99: 14.81 P99.9: 940.62 P99.99: 1437.58 ------------------------------------------------------ [ 0, 1 ] 3878 0.811% 0.811% ( 1, 2 ] 190894 39.912% 40.722% ######## ( 2, 3 ] 150485 31.463% 72.186% ###### ( 3, 4 ] 53084 11.099% 83.284% ## ( 4, 6 ] 58109 12.149% 95.434% ## ( 6, 10 ] 13824 2.890% 98.324% # ( 10, 15 ] 3361 0.703% 99.027% ( 15, 22 ] 540 0.113% 99.139% ( 22, 34 ] 130 0.027% 99.167% ( 34, 51 ] 164 0.034% 99.201% ( 51, 76 ] 89 0.019% 99.220% ( 76, 110 ] 28 0.006% 99.225% ( 110, 170 ] 68 0.014% 99.240% ( 170, 250 ] 234 0.049% 99.289% ( 250, 380 ] 640 0.134% 99.422% ( 380, 580 ] 1198 0.250% 99.673% ( 580, 870 ] 1012 0.212% 99.884% ( 870, 1300 ] 461 0.096% 99.981% ( 1300, 1900 ] 197 0.041% 100.022% ( 1900, 2900 ] 228 0.048% 100.070% ( 2900, 4400 ] 290 0.061% 100.130% ( 4400, 6600 ] 80 0.017% 100.147% ( 6600, 9900 ] 10 0.002% 100.149% ( 9900, 14000 ] 7 0.001% 100.151% ( 14000, 22000 ] 6 0.001% 100.152% ( 22000, 33000 ] 14 0.003% 100.155% ( 33000, 50000 ] 5 0.001% 100.156% ( 50000, 75000 ] 1 0.000% 100.156% ** Level 4 read latency histogram (micros): Count: 438817 Average: 29.4945 StdDev: 324.24 Min: 1 Median: 2.2941 Max: 60016 Percentiles: P50: 2.29 P75: 3.34 P99: 628.74 P99.9: 2124.31 P99.99: 2820.84 ------------------------------------------------------ [ 0, 1 ] 4161 0.948% 0.948% ( 1, 2 ] 176101 40.131% 41.079% ######## ( 2, 3 ] 133107 30.333% 71.412% ###### ( 3, 4 ] 46802 10.665% 82.078% ## ( 4, 6 ] 50895 11.598% 93.676% ## ( 6, 10 ] 13038 2.971% 96.647% # ( 10, 15 ] 2935 0.669% 97.316% ( 15, 22 ] 383 0.087% 97.403% ( 22, 34 ] 93 0.021% 97.424% ( 34, 51 ] 158 0.036% 97.460% ( 51, 76 ] 84 0.019% 97.480% ( 76, 110 ] 37 0.008% 97.488% ( 110, 170 ] 112 0.026% 97.514% ( 170, 250 ] 659 0.150% 97.664% ( 250, 380 ] 2044 0.466% 98.130% ( 380, 580 ] 3361 0.766% 98.895% ( 580, 870 ] 2736 0.623% 99.519% ( 870, 1300 ] 1075 0.245% 99.764% ( 1300, 1900 ] 471 0.107% 99.871% ( 1900, 2900 ] 567 0.129% 100.000% ( 2900, 4400 ] 659 0.150% 100.151% ( 4400, 6600 ] 145 0.033% 100.184% ( 6600, 9900 ] 24 0.005% 100.189% ( 9900, 14000 ] 5 0.001% 100.190% ( 14000, 22000 ] 11 0.003% 100.193% ( 22000, 33000 ] 11 0.003% 100.195% ( 33000, 50000 ] 5 0.001% 100.196% ( 50000, 75000 ] 1 0.000% 100.197% ** Level 5 read latency histogram (micros): Count: 9235 Average: 894.2992 StdDev: 1716.75 Min: 102 Median: 558.8048 Max: 60917 Percentiles: P50: 558.80 P75: 843.70 P99: 4908.59 P99.9: 24805.00 P99.99: 60917.00 ------------------------------------------------------ ( 76, 110 ] 2 0.022% 0.022% ( 110, 170 ] 78 0.845% 0.866% ( 170, 250 ] 521 5.642% 6.508% # ( 250, 380 ] 1608 17.412% 23.920% ### ( 380, 580 ] 2694 29.172% 53.091% ###### ( 580, 870 ] 2225 24.093% 77.185% ##### ( 870, 1300 ] 876 9.486% 86.670% ## ( 1300, 1900 ] 331 3.584% 90.254% # ( 1900, 2900 ] 383 4.147% 94.402% # ( 2900, 4400 ] 405 4.385% 98.787% # ( 4400, 6600 ] 85 0.920% 99.708% ( 6600, 9900 ] 12 0.130% 99.838% ( 9900, 14000 ] 2 0.022% 99.859% ( 14000, 22000 ] 3 0.032% 99.892% ( 22000, 33000 ] 3 0.032% 99.924% ( 33000, 50000 ] 4 0.043% 99.968% ( 50000, 75000 ] 3 0.032% 100.000% ** DB Stats ** Uptime(secs): 6.0 total, 6.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 162.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.307 H:M:S, 21.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 165.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.307 H:M:S, 21.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/10/14-22:10:49 ... thread 0: (1000000,2000000) ops and (210121.2,186721.6) ops/second in (4.759158,10.711132) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/6 2.05 GB 175.3 1.4 0.0 1.4 3.2 1.8 0.0 1.7 73.0 172.2 18.95 11.45 31 0.611 1405K 7373 0.0 0.0 L2 0/0 0.00 KB 0.0 1.1 1.0 0.1 1.0 1.0 0.0 1.1 151.2 149.0 7.19 5.30 1 7.193 1104K 16K 0.0 0.0 L3 24/5 1.20 GB 1.0 3.2 2.4 0.8 3.2 2.4 0.2 1.3 144.9 142.9 22.79 16.20 15 1.519 2274K 8461 0.0 0.0 L4 144/15 9.99 GB 0.9 4.0 1.8 2.2 3.6 1.4 1.0 2.0 146.1 132.4 28.00 18.89 18 1.556 1225K 2548 0.0 0.0 L5 144/0 11.63 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 327/26 24.87 GB 0.0 9.6 5.2 4.5 11.0 6.6 3.1 6.0 128.2 146.9 76.93 51.83 65 1.184 6010K 34K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.6 5.2 4.5 11.0 6.6 3.1 6.0 128.2 146.9 76.93 51.83 65 1.184 6010K 34K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.6 5.2 4.5 9.2 4.7 0.0 0.0 147.1 140.4 67.06 46.44 39 1.720 6010K 34K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 191.1 9.87 5.39 26 0.380 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.8 total, 10.7 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.03 GB write, 1046.43 MB/s write, 9.63 GB read, 913.47 MB/s read, 76.9 seconds Interval compaction: 11.03 GB write, 1054.57 MB/s write, 9.63 GB read, 920.58 MB/s read, 76.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 19, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 376170 Average: 47.7886 StdDev: 371.19 Min: 1 Median: 1.9602 Max: 48465 Percentiles: P50: 1.96 P75: 2.97 P99: 800.33 P99.9: 3343.21 P99.99: 4117.34 ------------------------------------------------------ [ 0, 1 ] 13911 3.698% 3.698% # ( 1, 2 ] 181390 48.220% 51.918% ########## ( 2, 3 ] 89320 23.745% 75.663% ##### ( 3, 4 ] 29546 7.854% 83.517% ## ( 4, 6 ] 27642 7.348% 90.866% # ( 6, 10 ] 6030 1.603% 92.469% ( 10, 15 ] 1331 0.354% 92.822% ( 15, 22 ] 148 0.039% 92.862% ( 22, 34 ] 41 0.011% 92.873% ( 34, 51 ] 40 0.011% 92.883% ( 51, 76 ] 22 0.006% 92.889% ( 76, 110 ] 24 0.006% 92.895% ( 110, 170 ] 906 0.241% 93.136% ( 170, 250 ] 4992 1.327% 94.463% ( 250, 380 ] 6999 1.861% 96.324% ( 380, 580 ] 7006 1.862% 98.186% ( 580, 870 ] 4028 1.071% 99.257% ( 870, 1300 ] 1227 0.326% 99.583% ( 1300, 1900 ] 336 0.089% 99.673% ( 1900, 2900 ] 661 0.176% 99.848% ( 2900, 4400 ] 656 0.174% 100.023% ( 4400, 6600 ] 117 0.031% 100.054% ( 6600, 9900 ] 39 0.010% 100.064% ( 9900, 14000 ] 5 0.001% 100.066% ( 14000, 22000 ] 11 0.003% 100.069% ( 22000, 33000 ] 12 0.003% 100.072% ( 33000, 50000 ] 9 0.002% 100.074% ** Level 1 read latency histogram (micros): Count: 256162 Average: 12.1159 StdDev: 177.20 Min: 1 Median: 2.2025 Max: 34332 Percentiles: P50: 2.20 P75: 3.10 P99: 171.48 P99.9: 1950.93 P99.99: 5677.25 ------------------------------------------------------ [ 0, 1 ] 2517 0.983% 0.983% ( 1, 2 ] 109963 42.927% 43.910% ######### ( 2, 3 ] 77034 30.072% 73.982% ###### ( 3, 4 ] 26167 10.215% 84.197% ## ( 4, 6 ] 28222 11.017% 95.214% ## ( 6, 10 ] 7514 2.933% 98.148% # ( 10, 15 ] 1626 0.635% 98.782% ( 15, 22 ] 247 0.096% 98.879% ( 22, 34 ] 77 0.030% 98.909% ( 34, 51 ] 86 0.034% 98.942% ( 51, 76 ] 58 0.023% 98.965% ( 76, 110 ] 14 0.005% 98.971% ( 110, 170 ] 68 0.027% 98.997% ( 170, 250 ] 400 0.156% 99.153% ( 250, 380 ] 559 0.218% 99.371% ( 380, 580 ] 592 0.231% 99.603% ( 580, 870 ] 459 0.179% 99.782% ( 870, 1300 ] 203 0.079% 99.861% ( 1300, 1900 ] 95 0.037% 99.898% ( 1900, 2900 ] 95 0.037% 99.935% ( 2900, 4400 ] 116 0.045% 99.980% ( 4400, 6600 ] 42 0.016% 99.997% ( 6600, 9900 ] 6 0.002% 99.999% ( 9900, 14000 ] 4 0.002% 100.001% ( 14000, 22000 ] 2 0.001% 100.002% ( 22000, 33000 ] 2 0.001% 100.002% ( 33000, 50000 ] 1 0.000% 100.003% ** Level 2 read latency histogram (micros): Count: 562057 Average: 8.5022 StdDev: 177.55 Min: 1 Median: 2.2352 Max: 44523 Percentiles: P50: 2.24 P75: 3.09 P99: 11.38 P99.9: 529.26 P99.99: 814.98 ------------------------------------------------------ [ 0, 1 ] 3969 0.706% 0.706% ( 1, 2 ] 235508 41.901% 42.607% ######## ( 2, 3 ] 176695 31.437% 74.044% ###### ( 3, 4 ] 60934 10.841% 84.886% ## ( 4, 6 ] 62523 11.124% 96.010% ## ( 6, 10 ] 15793 2.810% 98.820% # ( 10, 15 ] 3669 0.653% 99.472% ( 15, 22 ] 498 0.089% 99.561% ( 22, 34 ] 123 0.022% 99.583% ( 34, 51 ] 258 0.046% 99.629% ( 51, 76 ] 122 0.022% 99.650% ( 76, 110 ] 28 0.005% 99.655% ( 110, 170 ] 63 0.011% 99.667% ( 170, 250 ] 280 0.050% 99.716% ( 250, 380 ] 564 0.100% 99.817% ( 380, 580 ] 627 0.112% 99.928% ( 580, 870 ] 428 0.076% 100.004% ( 870, 1300 ] 181 0.032% 100.037% ( 1300, 1900 ] 139 0.025% 100.061% ( 1900, 2900 ] 159 0.028% 100.090% ( 2900, 4400 ] 135 0.024% 100.114% ( 4400, 6600 ] 59 0.010% 100.124% ( 6600, 9900 ] 17 0.003% 100.127% ( 9900, 14000 ] 6 0.001% 100.128% ( 14000, 22000 ] 7 0.001% 100.130% ( 22000, 33000 ] 6 0.001% 100.131% ( 33000, 50000 ] 2 0.000% 100.131% ** Level 3 read latency histogram (micros): Count: 633688 Average: 14.4305 StdDev: 245.94 Min: 1 Median: 2.2931 Max: 52157 Percentiles: P50: 2.29 P75: 3.25 P99: 183.06 P99.9: 1001.00 P99.99: 1695.93 ------------------------------------------------------ [ 0, 1 ] 5110 0.806% 0.806% ( 1, 2 ] 253268 39.967% 40.774% ######## ( 2, 3 ] 199495 31.482% 72.255% ###### ( 3, 4 ] 69681 10.996% 83.251% ## ( 4, 6 ] 75762 11.956% 95.207% ## ( 6, 10 ] 18227 2.876% 98.083% # ( 10, 15 ] 4362 0.688% 98.772% ( 15, 22 ] 652 0.103% 98.875% ( 22, 34 ] 149 0.024% 98.898% ( 34, 51 ] 201 0.032% 98.930% ( 51, 76 ] 104 0.016% 98.946% ( 76, 110 ] 37 0.006% 98.952% ( 110, 170 ] 174 0.027% 98.980% ( 170, 250 ] 797 0.126% 99.105% ( 250, 380 ] 1447 0.228% 99.334% ( 380, 580 ] 1987 0.314% 99.647% ( 580, 870 ] 1425 0.225% 99.872% ( 870, 1300 ] 582 0.092% 99.964% ( 1300, 1900 ] 251 0.040% 100.004% ( 1900, 2900 ] 296 0.047% 100.050% ( 2900, 4400 ] 361 0.057% 100.107% ( 4400, 6600 ] 93 0.015% 100.122% ( 6600, 9900 ] 19 0.003% 100.125% ( 9900, 14000 ] 10 0.002% 100.127% ( 14000, 22000 ] 10 0.002% 100.128% ( 22000, 33000 ] 15 0.002% 100.131% ( 33000, 50000 ] 6 0.001% 100.131% ( 50000, 75000 ] 1 0.000% 100.132% ** Level 4 read latency histogram (micros): Count: 864972 Average: 26.5677 StdDev: 286.17 Min: 1 Median: 2.3036 Max: 60016 Percentiles: P50: 2.30 P75: 3.38 P99: 535.46 P99.9: 1297.10 P99.99: 2009.61 ------------------------------------------------------ [ 0, 1 ] 7536 0.871% 0.871% ( 1, 2 ] 346203 40.025% 40.896% ######## ( 2, 3 ] 259386 29.988% 70.884% ###### ( 3, 4 ] 94787 10.958% 81.842% ## ( 4, 6 ] 100011 11.562% 93.405% ## ( 6, 10 ] 25426 2.940% 96.344% # ( 10, 15 ] 5868 0.678% 97.022% ( 15, 22 ] 738 0.085% 97.108% ( 22, 34 ] 153 0.018% 97.125% ( 34, 51 ] 262 0.030% 97.156% ( 51, 76 ] 175 0.020% 97.176% ( 76, 110 ] 75 0.009% 97.185% ( 110, 170 ] 733 0.085% 97.269% ( 170, 250 ] 3704 0.428% 97.698% ( 250, 380 ] 5919 0.684% 98.382% ( 380, 580 ] 6883 0.796% 99.178% ( 580, 870 ] 4638 0.536% 99.714% ( 870, 1300 ] 1625 0.188% 99.902% ( 1300, 1900 ] 666 0.077% 99.979% ( 1900, 2900 ] 926 0.107% 100.086% ( 2900, 4400 ] 941 0.109% 100.195% ( 4400, 6600 ] 197 0.023% 100.217% ( 6600, 9900 ] 49 0.006% 100.223% ( 9900, 14000 ] 15 0.002% 100.225% ( 14000, 22000 ] 29 0.003% 100.228% ( 22000, 33000 ] 17 0.002% 100.230% ( 33000, 50000 ] 7 0.001% 100.231% ( 50000, 75000 ] 1 0.000% 100.231% ** Level 5 read latency histogram (micros): Count: 20253 Average: 705.4929 StdDev: 1429.06 Min: 102 Median: 450.3836 Max: 60917 Percentiles: P50: 450.38 P75: 711.59 P99: 4259.70 P99.9: 19425.14 P99.99: 58122.50 ------------------------------------------------------ ( 76, 110 ] 6 0.030% 0.030% ( 110, 170 ] 586 2.893% 2.923% # ( 170, 250 ] 2975 14.689% 17.612% ### ( 250, 380 ] 4688 23.147% 40.759% ##### ( 380, 580 ] 5318 26.258% 67.017% ##### ( 580, 870 ] 3563 17.592% 84.610% #### ( 870, 1300 ] 1308 6.458% 91.068% # ( 1300, 1900 ] 464 2.291% 93.359% ( 1900, 2900 ] 614 3.032% 96.391% # ( 2900, 4400 ] 583 2.879% 99.269% # ( 4400, 6600 ] 101 0.499% 99.768% ( 6600, 9900 ] 18 0.089% 99.857% ( 9900, 14000 ] 4 0.020% 99.877% ( 14000, 22000 ] 7 0.035% 99.911% ( 22000, 33000 ] 9 0.044% 99.956% ( 33000, 50000 ] 6 0.030% 99.985% ( 50000, 75000 ] 3 0.015% 100.000% ** DB Stats ** Uptime(secs): 10.8 total, 4.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 182.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.874 H:M:S, 17.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 206.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.567 H:M:S, 11.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/10/14-22:10:55 ... thread 0: (1000000,3000000) ops and (192042.2,188462.1) ops/second in (5.207189,15.918321) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 2.96 GB 187.7 2.4 0.0 2.4 5.1 2.8 0.0 1.9 94.1 202.1 26.07 18.11 50 0.521 2490K 12K 0.0 0.0 L2 0/0 0.00 KB 0.0 1.1 1.0 0.1 1.0 1.0 0.0 1.1 151.2 149.0 7.19 5.30 1 7.193 1104K 16K 0.0 0.0 L3 19/0 973.51 MB 1.0 3.2 2.4 0.8 3.2 2.4 0.2 1.3 144.9 142.9 22.79 16.20 15 1.519 2274K 8461 0.0 0.0 L4 145/0 9.68 GB 1.0 5.5 2.0 3.4 4.9 1.4 1.0 2.4 151.8 134.4 36.97 25.22 23 1.607 1489K 2548 0.0 0.0 L5 148/0 11.94 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 330/10 25.53 GB 0.0 12.2 5.4 6.7 14.2 7.5 3.4 5.1 133.9 156.6 93.02 64.82 89 1.045 7359K 39K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.2 5.4 6.7 14.2 7.5 3.4 5.1 133.9 156.6 93.02 64.82 89 1.045 7359K 39K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.2 5.4 6.7 11.5 4.7 0.0 0.0 155.3 146.4 80.18 56.84 48 1.670 7359K 39K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 220.4 12.84 7.98 41 0.313 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.0 total, 15.9 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.23 GB write, 910.13 MB/s write, 12.16 GB read, 778.03 MB/s read, 93.0 seconds Interval compaction: 14.23 GB write, 914.90 MB/s write, 12.16 GB read, 782.11 MB/s read, 93.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 19, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 727209 Average: 36.7066 StdDev: 271.36 Min: 0 Median: 1.7286 Max: 48465 Percentiles: P50: 1.73 P75: 2.70 P99: 565.69 P99.9: 2247.05 P99.99: 3403.69 ------------------------------------------------------ [ 0, 1 ] 92045 12.657% 12.657% ### ( 1, 2 ] 372705 51.251% 63.909% ########## ( 2, 3 ] 115927 15.941% 79.850% ### ( 3, 4 ] 37398 5.143% 84.993% # ( 4, 6 ] 32130 4.418% 89.411% # ( 6, 10 ] 7240 0.996% 90.407% ( 10, 15 ] 1621 0.223% 90.630% ( 15, 22 ] 206 0.028% 90.658% ( 22, 34 ] 54 0.007% 90.665% ( 34, 51 ] 44 0.006% 90.671% ( 51, 76 ] 23 0.003% 90.674% ( 76, 110 ] 692 0.095% 90.770% ( 110, 170 ] 14167 1.948% 92.718% ( 170, 250 ] 28229 3.882% 96.600% # ( 250, 380 ] 10113 1.391% 97.990% ( 380, 580 ] 7910 1.088% 99.078% ( 580, 870 ] 4163 0.572% 99.650% ( 870, 1300 ] 1247 0.171% 99.822% ( 1300, 1900 ] 338 0.046% 99.868% ( 1900, 2900 ] 665 0.091% 99.960% ( 2900, 4400 ] 656 0.090% 100.050% ( 4400, 6600 ] 117 0.016% 100.066% ( 6600, 9900 ] 40 0.006% 100.072% ( 9900, 14000 ] 5 0.001% 100.072% ( 14000, 22000 ] 11 0.002% 100.074% ( 22000, 33000 ] 12 0.002% 100.075% ( 33000, 50000 ] 9 0.001% 100.077% ** Level 1 read latency histogram (micros): Count: 256162 Average: 12.1159 StdDev: 177.20 Min: 1 Median: 2.2025 Max: 34332 Percentiles: P50: 2.20 P75: 3.10 P99: 171.48 P99.9: 1950.93 P99.99: 5677.25 ------------------------------------------------------ [ 0, 1 ] 2517 0.983% 0.983% ( 1, 2 ] 109963 42.927% 43.910% ######### ( 2, 3 ] 77034 30.072% 73.982% ###### ( 3, 4 ] 26167 10.215% 84.197% ## ( 4, 6 ] 28222 11.017% 95.214% ## ( 6, 10 ] 7514 2.933% 98.148% # ( 10, 15 ] 1626 0.635% 98.782% ( 15, 22 ] 247 0.096% 98.879% ( 22, 34 ] 77 0.030% 98.909% ( 34, 51 ] 86 0.034% 98.942% ( 51, 76 ] 58 0.023% 98.965% ( 76, 110 ] 14 0.005% 98.971% ( 110, 170 ] 68 0.027% 98.997% ( 170, 250 ] 400 0.156% 99.153% ( 250, 380 ] 559 0.218% 99.371% ( 380, 580 ] 592 0.231% 99.603% ( 580, 870 ] 459 0.179% 99.782% ( 870, 1300 ] 203 0.079% 99.861% ( 1300, 1900 ] 95 0.037% 99.898% ( 1900, 2900 ] 95 0.037% 99.935% ( 2900, 4400 ] 116 0.045% 99.980% ( 4400, 6600 ] 42 0.016% 99.997% ( 6600, 9900 ] 6 0.002% 99.999% ( 9900, 14000 ] 4 0.002% 100.001% ( 14000, 22000 ] 2 0.001% 100.002% ( 22000, 33000 ] 2 0.001% 100.002% ( 33000, 50000 ] 1 0.000% 100.003% ** Level 2 read latency histogram (micros): Count: 562057 Average: 8.5022 StdDev: 177.55 Min: 1 Median: 2.2352 Max: 44523 Percentiles: P50: 2.24 P75: 3.09 P99: 11.38 P99.9: 529.26 P99.99: 814.98 ------------------------------------------------------ [ 0, 1 ] 3969 0.706% 0.706% ( 1, 2 ] 235508 41.901% 42.607% ######## ( 2, 3 ] 176695 31.437% 74.044% ###### ( 3, 4 ] 60934 10.841% 84.886% ## ( 4, 6 ] 62523 11.124% 96.010% ## ( 6, 10 ] 15793 2.810% 98.820% # ( 10, 15 ] 3669 0.653% 99.472% ( 15, 22 ] 498 0.089% 99.561% ( 22, 34 ] 123 0.022% 99.583% ( 34, 51 ] 258 0.046% 99.629% ( 51, 76 ] 122 0.022% 99.650% ( 76, 110 ] 28 0.005% 99.655% ( 110, 170 ] 63 0.011% 99.667% ( 170, 250 ] 280 0.050% 99.716% ( 250, 380 ] 564 0.100% 99.817% ( 380, 580 ] 627 0.112% 99.928% ( 580, 870 ] 428 0.076% 100.004% ( 870, 1300 ] 181 0.032% 100.037% ( 1300, 1900 ] 139 0.025% 100.061% ( 1900, 2900 ] 159 0.028% 100.090% ( 2900, 4400 ] 135 0.024% 100.114% ( 4400, 6600 ] 59 0.010% 100.124% ( 6600, 9900 ] 17 0.003% 100.127% ( 9900, 14000 ] 6 0.001% 100.128% ( 14000, 22000 ] 7 0.001% 100.130% ( 22000, 33000 ] 6 0.001% 100.131% ( 33000, 50000 ] 2 0.000% 100.131% ** Level 3 read latency histogram (micros): Count: 643520 Average: 16.3485 StdDev: 244.90 Min: 1 Median: 2.3070 Max: 52157 Percentiles: P50: 2.31 P75: 3.32 P99: 249.03 P99.9: 995.52 P99.99: 1695.97 ------------------------------------------------------ [ 0, 1 ] 5361 0.833% 0.833% ( 1, 2 ] 254965 39.620% 40.453% ######## ( 2, 3 ] 200121 31.098% 71.551% ###### ( 3, 4 ] 69818 10.849% 82.401% ## ( 4, 6 ] 75893 11.793% 94.194% ## ( 6, 10 ] 18281 2.841% 97.035% # ( 10, 15 ] 4365 0.678% 97.713% ( 15, 22 ] 654 0.102% 97.815% ( 22, 34 ] 150 0.023% 97.838% ( 34, 51 ] 201 0.031% 97.869% ( 51, 76 ] 104 0.016% 97.886% ( 76, 110 ] 133 0.021% 97.906% ( 110, 170 ] 2372 0.369% 98.275% ( 170, 250 ] 4724 0.734% 99.009% ( 250, 380 ] 1958 0.304% 99.313% ( 380, 580 ] 2154 0.335% 99.648% ( 580, 870 ] 1452 0.226% 99.874% ( 870, 1300 ] 584 0.091% 99.964% ( 1300, 1900 ] 251 0.039% 100.003% ( 1900, 2900 ] 297 0.046% 100.049% ( 2900, 4400 ] 361 0.056% 100.106% ( 4400, 6600 ] 93 0.014% 100.120% ( 6600, 9900 ] 19 0.003% 100.123% ( 9900, 14000 ] 10 0.002% 100.124% ( 14000, 22000 ] 10 0.002% 100.126% ( 22000, 33000 ] 15 0.002% 100.128% ( 33000, 50000 ] 6 0.001% 100.129% ( 50000, 75000 ] 1 0.000% 100.129% ** Level 4 read latency histogram (micros): Count: 916156 Average: 32.5231 StdDev: 280.27 Min: 1 Median: 2.3598 Max: 60016 Percentiles: P50: 2.36 P75: 3.63 P99: 529.27 P99.9: 1281.08 P99.99: 1987.89 ------------------------------------------------------ [ 0, 1 ] 8546 0.933% 0.933% ( 1, 2 ] 354801 38.727% 39.660% ######## ( 2, 3 ] 263265 28.736% 68.396% ###### ( 3, 4 ] 96180 10.498% 78.894% ## ( 4, 6 ] 101403 11.068% 89.962% ## ( 6, 10 ] 25800 2.816% 92.778% # ( 10, 15 ] 5936 0.648% 93.426% ( 15, 22 ] 749 0.082% 93.508% ( 22, 34 ] 158 0.017% 93.525% ( 34, 51 ] 263 0.029% 93.554% ( 51, 76 ] 176 0.019% 93.573% ( 76, 110 ] 578 0.063% 93.636% ( 110, 170 ] 11770 1.285% 94.921% ( 170, 250 ] 23084 2.520% 97.441% # ( 250, 380 ] 8576 0.936% 98.377% ( 380, 580 ] 7651 0.835% 99.212% ( 580, 870 ] 4737 0.517% 99.729% ( 870, 1300 ] 1640 0.179% 99.908% ( 1300, 1900 ] 671 0.073% 99.981% ( 1900, 2900 ] 926 0.101% 100.082% ( 2900, 4400 ] 941 0.103% 100.185% ( 4400, 6600 ] 197 0.022% 100.207% ( 6600, 9900 ] 49 0.005% 100.212% ( 9900, 14000 ] 15 0.002% 100.214% ( 14000, 22000 ] 29 0.003% 100.217% ( 22000, 33000 ] 17 0.002% 100.219% ( 33000, 50000 ] 7 0.001% 100.219% ( 50000, 75000 ] 1 0.000% 100.219% ** Level 5 read latency histogram (micros): Count: 49101 Average: 406.2946 StdDev: 952.86 Min: 90 Median: 229.4939 Max: 60917 Percentiles: P50: 229.49 P75: 395.03 P99: 3517.47 P99.9: 6554.24 P99.99: 44588.05 ------------------------------------------------------ ( 76, 110 ] 440 0.896% 0.896% ( 110, 170 ] 9858 20.077% 20.973% #### ( 170, 250 ] 19165 39.032% 60.005% ######## ( 250, 380 ] 6916 14.085% 74.090% ### ( 380, 580 ] 5943 12.104% 86.194% ## ( 580, 870 ] 3657 7.448% 93.642% # ( 870, 1300 ] 1310 2.668% 96.310% # ( 1300, 1900 ] 464 0.945% 97.255% ( 1900, 2900 ] 617 1.257% 98.511% ( 2900, 4400 ] 583 1.187% 99.699% ( 4400, 6600 ] 101 0.206% 99.904% ( 6600, 9900 ] 18 0.037% 99.941% ( 9900, 14000 ] 4 0.008% 99.949% ( 14000, 22000 ] 7 0.014% 99.963% ( 22000, 33000 ] 9 0.018% 99.982% ( 33000, 50000 ] 6 0.012% 99.994% ( 50000, 75000 ] 3 0.006% 100.000% ** DB Stats ** Uptime(secs): 16.0 total, 5.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 184.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.331 H:M:S, 20.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 189.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.457 H:M:S, 28.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 396.048 micros/op 10049 ops/sec 20.200 seconds 202996 operations; 9.7 MB/s (50999 of 50999 found) Microseconds per read: Count: 202996 Average: 396.0601 StdDev: 1021.32 Min: 2 Median: 241.4883 Max: 106112 Percentiles: P50: 241.49 P75: 390.26 P99: 3136.34 P99.9: 13581.80 P99.99: 42471.75 ------------------------------------------------------ ( 1, 2 ] 5 0.002% 0.002% ( 2, 3 ] 44 0.022% 0.024% ( 3, 4 ] 71 0.035% 0.059% ( 4, 6 ] 170 0.084% 0.143% ( 6, 10 ] 300 0.148% 0.291% ( 10, 15 ] 1249 0.615% 0.906% ( 15, 22 ] 2434 1.199% 2.105% ( 22, 34 ] 4441 2.188% 4.293% ( 34, 51 ] 1987 0.979% 5.272% ( 51, 76 ] 342 0.168% 5.440% ( 76, 110 ] 82 0.040% 5.480% ( 110, 170 ] 14170 6.980% 12.461% # ( 170, 250 ] 85276 42.009% 54.470% ######## ( 250, 380 ] 40216 19.811% 74.281% #### ( 380, 580 ] 28447 14.014% 88.294% ### ( 580, 870 ] 13387 6.595% 94.889% # ( 870, 1300 ] 5004 2.465% 97.354% ( 1300, 1900 ] 1721 0.848% 98.202% ( 1900, 2900 ] 1393 0.686% 98.888% ( 2900, 4400 ] 1441 0.710% 99.598% ( 4400, 6600 ] 380 0.187% 99.785% ( 6600, 9900 ] 145 0.071% 99.857% ( 9900, 14000 ] 98 0.048% 99.905% ( 14000, 22000 ] 99 0.049% 99.954% ( 22000, 33000 ] 62 0.031% 99.984% ( 33000, 50000 ] 21 0.010% 99.995% ( 50000, 75000 ] 10 0.005% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3410165 rocksdb.bloom.filter.full.positive COUNT : 235528 rocksdb.bloom.filter.full.true.positive COUNT : 202162 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 834 rocksdb.memtable.miss COUNT : 202162 rocksdb.l0.hit COUNT : 23704 rocksdb.l1.hit COUNT : 1661 rocksdb.l2andup.hit COUNT : 176797 rocksdb.compaction.key.drop.new COUNT : 743164 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3469032 rocksdb.number.keys.read COUNT : 202996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3580041024 rocksdb.bytes.read COUNT : 202996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 502 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 5816436 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 14688973109 rocksdb.compact.write.bytes COUNT : 13918977141 rocksdb.flush.write.bytes COUNT : 3561493901 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 23 rocksdb.number.superversion_acquires COUNT : 686 rocksdb.number.superversion_releases COUNT : 669 rocksdb.number.superversion_cleanups COUNT : 170 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 15 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3538327552 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6464512 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 14884426987 rocksdb.non.last.level.read.count COUNT : 3567748 rocksdb.block.checksum.compute.count COUNT : 3796251 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 240.720661 P95 : 887.768737 P99 : 3135.458333 P100 : 106110.000000 COUNT : 202996 SUM : 80208834 rocksdb.db.write.micros P50 : 1.595764 P95 : 5.187170 P99 : 8.094330 P100 : 554913.000000 COUNT : 3469032 SUM : 15543360 rocksdb.compaction.times.micros P50 : 1525862.068966 P95 : 3215000.000000 P99 : 7193446.000000 P100 : 7193446.000000 COUNT : 51 SUM : 85160526 rocksdb.compaction.times.cpu_micros P50 : 1171666.666667 P95 : 1882500.000000 P99 : 5295456.000000 P100 : 5295456.000000 COUNT : 51 SUM : 61749605 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 956.000000 P95 : 5500.000000 P99 : 6652.000000 P100 : 6652.000000 COUNT : 50 SUM : 77212 rocksdb.compaction.outfile.sync.micros P50 : 1680.000000 P95 : 5676.000000 P99 : 9196.000000 P100 : 11727.000000 COUNT : 164 SUM : 370942 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 210.000000 P95 : 3437.500000 P99 : 5119.000000 P100 : 5119.000000 COUNT : 117 SUM : 67068 rocksdb.table.open.io.micros P50 : 5072.222222 P95 : 17654.054054 P99 : 21995.675676 P100 : 31890.000000 COUNT : 502 SUM : 3027466 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.285153 P95 : 9.814169 P99 : 234.399192 P100 : 52164.000000 COUNT : 3557385 SUM : 53949492 rocksdb.read.block.get.micros P50 : 209.098476 P95 : 769.915866 P99 : 2667.092063 P100 : 60922.000000 COUNT : 238483 SUM : 71861444 rocksdb.write.raw.block.micros P50 : 0.531478 P95 : 1.256456 P99 : 4.257355 P100 : 57414.000000 COUNT : 4234770 SUM : 14254657 rocksdb.numfiles.in.singlecompaction P50 : 3.015625 P95 : 3.957813 P99 : 7.320000 P100 : 9.000000 COUNT : 67 SUM : 220 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561663 P95 : 1143.718295 P99 : 2317.302505 P100 : 554712.000000 COUNT : 31042 SUM : 5818886 rocksdb.sst.read.micros P50 : 2.090276 P95 : 194.818094 P99 : 528.109760 P100 : 60917.000000 COUNT : 3567978 SUM : 113502555 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 202996 SUM : 202996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3469032 SUM : 3580041024 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 234516.129032 P95 : 561363.636364 P99 : 868308.000000 P100 : 868308.000000 COUNT : 50 SUM : 14596061 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 172 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0