[2024-11-20 12:43:29.867035] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-20 12:43:29.867293] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid343655 ] Set seed to 1732103009860384 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 12:43:29.986383] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 12:43:30.207741] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 12:43:30.207788] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 343655' to capture a snapshot of events at runtime. [2024-11-20 12:43:30.207799] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid343655 for offline analysis/debug. [2024-11-20 12:43:30.207838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 12:43:38 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-12:43:49 ... thread 0: (1000000,1000000) ops and (96711.8,96711.8) ops/second in (10.339999,10.339999) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/5 1.56 GB 88.1 0.7 0.0 0.7 1.5 0.9 0.0 1.8 64.3 146.0 10.78 5.41 13 0.829 703K 860 0.0 0.0 L1 4/4 415.57 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 11/9 1.38 GB 2.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/4 1.28 GB 0.9 2.5 1.3 1.1 2.4 1.3 0.0 1.8 101.5 100.5 24.86 12.00 11 2.260 1499K 3139 0.0 0.0 L4 188/15 10.23 GB 1.0 5.2 3.0 2.2 5.1 2.9 0.1 1.7 116.5 114.6 45.50 24.72 32 1.422 2226K 795 0.0 0.0 L5 1112/0 91.35 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1341/37 106.20 GB 0.0 8.3 4.4 4.0 9.1 5.1 2.5 10.5 105.0 114.4 81.13 42.13 56 1.449 4429K 4794 0.0 0.0 Int 0/0 0.00 KB 0.0 8.3 4.4 4.0 9.1 5.1 2.5 10.5 105.0 114.4 81.13 42.13 56 1.449 4429K 4794 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.3 4.4 4.0 8.2 4.3 0.0 0.0 114.6 113.1 74.31 39.58 45 1.651 4429K 4794 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 129.2 6.83 2.55 11 0.620 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.6 total, 10.3 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.07 GB write, 879.60 MB/s write, 8.32 GB read, 806.91 MB/s read, 81.1 seconds Interval compaction: 9.07 GB write, 897.68 MB/s write, 8.32 GB read, 823.50 MB/s read, 81.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 23, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 14, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 356547 Average: 17.9174 StdDev: 189.53 Min: 1 Median: 1.9376 Max: 10210 Percentiles: P50: 1.94 P75: 3.00 P99: 264.48 P99.9: 3168.11 P99.99: 5125.39 ------------------------------------------------------ [ 0, 1 ] 12359 3.466% 3.466% # ( 1, 2 ] 176952 49.629% 53.096% ########## ( 2, 3 ] 78167 21.923% 75.019% #### ( 3, 4 ] 32947 9.241% 84.260% ## ( 4, 6 ] 41041 11.511% 95.770% ## ( 6, 10 ] 9032 2.533% 98.303% # ( 10, 15 ] 1992 0.559% 98.862% ( 15, 22 ] 187 0.052% 98.915% ( 22, 34 ] 16 0.004% 98.919% ( 34, 51 ] 13 0.004% 98.923% ( 51, 76 ] 12 0.003% 98.926% ( 76, 110 ] 8 0.002% 98.928% ( 110, 170 ] 61 0.017% 98.945% ( 170, 250 ] 161 0.045% 98.991% ( 250, 380 ] 301 0.084% 99.075% ( 380, 580 ] 497 0.139% 99.214% ( 580, 870 ] 699 0.196% 99.410% ( 870, 1300 ] 690 0.194% 99.604% ( 1300, 1900 ] 542 0.152% 99.756% ( 1900, 2900 ] 450 0.126% 99.882% ( 2900, 4400 ] 355 0.100% 99.982% ( 4400, 6600 ] 89 0.025% 100.007% ( 6600, 9900 ] 11 0.003% 100.010% ( 9900, 14000 ] 2 0.001% 100.010% ** Level 1 read latency histogram (micros): Count: 86993 Average: 11.3640 StdDev: 156.52 Min: 1 Median: 2.2919 Max: 10745 Percentiles: P50: 2.29 P75: 3.45 P99: 12.91 P99.9: 2471.57 P99.99: 6724.04 ------------------------------------------------------ [ 0, 1 ] 702 0.807% 0.807% ( 1, 2 ] 35550 40.865% 41.672% ######## ( 2, 3 ] 24822 28.533% 70.206% ###### ( 3, 4 ] 9184 10.557% 80.763% ## ( 4, 6 ] 12363 14.211% 94.974% ### ( 6, 10 ] 3025 3.477% 98.452% # ( 10, 15 ] 820 0.943% 99.394% ( 15, 22 ] 71 0.082% 99.476% ( 22, 34 ] 6 0.007% 99.483% ( 34, 51 ] 6 0.007% 99.490% ( 51, 76 ] 11 0.013% 99.502% ( 76, 110 ] 5 0.006% 99.508% ( 110, 170 ] 9 0.010% 99.518% ( 170, 250 ] 7 0.008% 99.526% ( 250, 380 ] 13 0.015% 99.541% ( 380, 580 ] 42 0.048% 99.590% ( 580, 870 ] 82 0.094% 99.684% ( 870, 1300 ] 104 0.120% 99.803% ( 1300, 1900 ] 56 0.064% 99.868% ( 1900, 2900 ] 49 0.056% 99.924% ( 2900, 4400 ] 38 0.044% 99.968% ( 4400, 6600 ] 19 0.022% 99.990% ( 6600, 9900 ] 8 0.009% 99.999% ( 9900, 14000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 417203 Average: 15.7753 StdDev: 185.34 Min: 1 Median: 2.1336 Max: 9340 Percentiles: P50: 2.13 P75: 3.27 P99: 13.95 P99.9: 2828.35 P99.99: 4205.27 ------------------------------------------------------ [ 0, 1 ] 7390 1.771% 1.771% ( 1, 2 ] 186927 44.805% 46.576% ######### ( 2, 3 ] 106950 25.635% 72.211% ##### ( 3, 4 ] 42311 10.142% 82.353% ## ( 4, 6 ] 53654 12.860% 95.213% ### ( 6, 10 ] 12893 3.090% 98.303% # ( 10, 15 ] 3675 0.881% 99.184% ( 15, 22 ] 462 0.111% 99.295% ( 22, 34 ] 58 0.014% 99.309% ( 34, 51 ] 38 0.009% 99.318% ( 51, 76 ] 43 0.010% 99.328% ( 76, 110 ] 13 0.003% 99.332% ( 110, 170 ] 19 0.005% 99.336% ( 170, 250 ] 61 0.015% 99.351% ( 250, 380 ] 92 0.022% 99.373% ( 380, 580 ] 214 0.051% 99.424% ( 580, 870 ] 370 0.089% 99.513% ( 870, 1300 ] 525 0.126% 99.639% ( 1300, 1900 ] 544 0.130% 99.769% ( 1900, 2900 ] 589 0.141% 99.910% ( 2900, 4400 ] 383 0.092% 100.002% ( 4400, 6600 ] 101 0.024% 100.026% ( 6600, 9900 ] 23 0.006% 100.032% ** Level 3 read latency histogram (micros): Count: 993952 Average: 9.2120 StdDev: 125.89 Min: 1 Median: 2.0657 Max: 9007 Percentiles: P50: 2.07 P75: 3.19 P99: 9.90 P99.9: 908.46 P99.99: 1513.44 ------------------------------------------------------ [ 0, 1 ] 19916 2.004% 2.004% ( 1, 2 ] 460959 46.376% 48.380% ######### ( 2, 3 ] 244916 24.641% 73.021% ##### ( 3, 4 ] 101594 10.221% 83.242% ## ( 4, 6 ] 129531 13.032% 96.274% ### ( 6, 10 ] 27805 2.797% 99.071% # ( 10, 15 ] 6087 0.612% 99.684% ( 15, 22 ] 659 0.066% 99.750% ( 22, 34 ] 53 0.005% 99.755% ( 34, 51 ] 77 0.008% 99.763% ( 51, 76 ] 72 0.007% 99.770% ( 76, 110 ] 25 0.003% 99.773% ( 110, 170 ] 33 0.003% 99.776% ( 170, 250 ] 73 0.007% 99.783% ( 250, 380 ] 169 0.017% 99.800% ( 380, 580 ] 335 0.034% 99.834% ( 580, 870 ] 591 0.059% 99.894% ( 870, 1300 ] 716 0.072% 99.966% ( 1300, 1900 ] 682 0.069% 100.034% ( 1900, 2900 ] 596 0.060% 100.094% ( 2900, 4400 ] 398 0.040% 100.134% ( 4400, 6600 ] 125 0.013% 100.147% ( 6600, 9900 ] 24 0.002% 100.149% ** Level 4 read latency histogram (micros): Count: 642252 Average: 22.3545 StdDev: 220.23 Min: 1 Median: 2.0717 Max: 12741 Percentiles: P50: 2.07 P75: 3.25 P99: 432.02 P99.9: 2768.02 P99.99: 3685.82 ------------------------------------------------------ [ 0, 1 ] 12618 1.965% 1.965% ( 1, 2 ] 297362 46.300% 48.265% ######### ( 2, 3 ] 155410 24.198% 72.462% ##### ( 3, 4 ] 64657 10.067% 82.529% ## ( 4, 6 ] 81085 12.625% 95.155% ### ( 6, 10 ] 18728 2.916% 98.071% # ( 10, 15 ] 4528 0.705% 98.776% ( 15, 22 ] 447 0.070% 98.845% ( 22, 34 ] 31 0.005% 98.850% ( 34, 51 ] 41 0.006% 98.856% ( 51, 76 ] 51 0.008% 98.864% ( 76, 110 ] 24 0.004% 98.868% ( 110, 170 ] 68 0.011% 98.879% ( 170, 250 ] 224 0.035% 98.914% ( 250, 380 ] 370 0.058% 98.971% ( 380, 580 ] 717 0.112% 99.083% ( 580, 870 ] 1313 0.204% 99.287% ( 870, 1300 ] 1617 0.252% 99.539% ( 1300, 1900 ] 1371 0.213% 99.752% ( 1900, 2900 ] 1093 0.170% 99.923% ( 2900, 4400 ] 828 0.129% 100.052% ( 4400, 6600 ] 258 0.040% 100.092% ( 6600, 9900 ] 29 0.005% 100.096% ( 9900, 14000 ] 1 0.000% 100.096% ** Level 5 read latency histogram (micros): Count: 17510 Average: 1687.9283 StdDev: 1500.02 Min: 90 Median: 1151.7521 Max: 12586 Percentiles: P50: 1151.75 P75: 2337.83 P99: 7183.60 P99.9: 9745.40 P99.99: 12586.00 ------------------------------------------------------ ( 76, 110 ] 20 0.114% 0.114% ( 110, 170 ] 201 1.148% 1.262% ( 170, 250 ] 450 2.570% 3.832% # ( 250, 380 ] 1004 5.734% 9.566% # ( 380, 580 ] 1994 11.388% 20.954% ## ( 580, 870 ] 3003 17.150% 38.104% ### ( 870, 1300 ] 3179 18.155% 56.259% #### ( 1300, 1900 ] 2373 13.552% 69.812% ### ( 1900, 2900 ] 2075 11.850% 81.662% ## ( 2900, 4400 ] 1997 11.405% 93.067% ## ( 4400, 6600 ] 1003 5.728% 98.795% # ( 6600, 9900 ] 203 1.159% 99.954% ( 9900, 14000 ] 8 0.046% 100.000% ** DB Stats ** Uptime(secs): 10.6 total, 10.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 93.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.401 H:M:S, 60.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 95.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.401 H:M:S, 61.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/20-12:43:53 ... thread 0: (1000000,2000000) ops and (216960.8,133787.1) ops/second in (4.609127,14.949126) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 1.84 GB 12.6 1.2 0.0 1.2 3.1 1.8 0.0 1.7 70.5 176.1 17.87 10.56 29 0.616 1279K 1458 0.0 0.0 L1 8/8 860.11 MB 0.0 1.1 0.7 0.4 1.1 0.7 0.0 1.6 89.8 89.4 12.56 5.42 1 12.556 1144K 4727 0.0 0.0 L2 1/0 72.43 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 987.08 MB 1.0 3.9 2.7 1.3 3.9 2.7 0.2 1.5 107.6 106.8 37.47 19.26 14 2.677 1682K 3181 0.0 0.0 L4 169/0 9.49 GB 1.0 8.1 4.7 3.4 8.0 4.6 0.3 1.7 124.4 122.6 66.47 38.65 46 1.445 3880K 1597 0.0 0.0 L5 1144/0 93.94 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1348/19 107.15 GB 0.0 14.3 8.1 6.3 16.0 9.8 5.7 8.7 109.3 122.2 134.37 73.90 90 1.493 7987K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.3 8.1 6.3 16.0 9.8 5.7 8.7 109.3 122.2 134.37 73.90 90 1.493 7987K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.3 8.1 6.3 14.2 7.9 0.0 0.0 119.4 118.1 123.09 68.49 65 1.894 7987K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 167.6 11.28 5.41 25 0.451 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.2 total, 15.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.04 GB write, 1083.31 MB/s write, 14.35 GB read, 968.91 MB/s read, 134.4 seconds Interval compaction: 16.04 GB write, 1098.71 MB/s write, 14.35 GB read, 982.68 MB/s read, 134.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 23, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 31, interval: 54 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 599600 Average: 16.7212 StdDev: 177.85 Min: 1 Median: 1.8287 Max: 10210 Percentiles: P50: 1.83 P75: 2.80 P99: 265.60 P99.9: 2893.96 P99.99: 4699.20 ------------------------------------------------------ [ 0, 1 ] 37223 6.208% 6.208% # ( 1, 2 ] 316856 52.845% 59.053% ########### ( 2, 3 ] 118938 19.836% 78.889% #### ( 3, 4 ] 47516 7.925% 86.813% ## ( 4, 6 ] 56808 9.474% 96.288% ## ( 6, 10 ] 11657 1.944% 98.232% ( 10, 15 ] 2389 0.398% 98.630% ( 15, 22 ] 245 0.041% 98.671% ( 22, 34 ] 27 0.005% 98.676% ( 34, 51 ] 17 0.003% 98.678% ( 51, 76 ] 15 0.003% 98.681% ( 76, 110 ] 94 0.016% 98.697% ( 110, 170 ] 852 0.142% 98.839% ( 170, 250 ] 876 0.146% 98.985% ( 250, 380 ] 775 0.129% 99.114% ( 380, 580 ] 1042 0.174% 99.288% ( 580, 870 ] 1248 0.208% 99.496% ( 870, 1300 ] 1077 0.180% 99.676% ( 1300, 1900 ] 755 0.126% 99.802% ( 1900, 2900 ] 596 0.099% 99.901% ( 2900, 4400 ] 517 0.086% 99.987% ( 4400, 6600 ] 140 0.023% 100.011% ( 6600, 9900 ] 21 0.004% 100.014% ( 9900, 14000 ] 2 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 125655 Average: 13.0048 StdDev: 162.71 Min: 1 Median: 2.2706 Max: 10745 Percentiles: P50: 2.27 P75: 3.40 P99: 16.92 P99.9: 2574.94 P99.99: 6558.53 ------------------------------------------------------ [ 0, 1 ] 956 0.761% 0.761% ( 1, 2 ] 52159 41.510% 42.271% ######## ( 2, 3 ] 35890 28.562% 70.833% ###### ( 3, 4 ] 13139 10.456% 81.289% ## ( 4, 6 ] 16914 13.461% 94.750% ### ( 6, 10 ] 4188 3.333% 98.083% # ( 10, 15 ] 1122 0.893% 98.976% ( 15, 22 ] 111 0.088% 99.064% ( 22, 34 ] 8 0.006% 99.070% ( 34, 51 ] 12 0.010% 99.080% ( 51, 76 ] 17 0.014% 99.094% ( 76, 110 ] 35 0.028% 99.121% ( 110, 170 ] 167 0.133% 99.254% ( 170, 250 ] 140 0.111% 99.366% ( 250, 380 ] 72 0.057% 99.423% ( 380, 580 ] 115 0.092% 99.515% ( 580, 870 ] 164 0.131% 99.645% ( 870, 1300 ] 175 0.139% 99.784% ( 1300, 1900 ] 90 0.072% 99.856% ( 1900, 2900 ] 82 0.065% 99.921% ( 2900, 4400 ] 57 0.045% 99.967% ( 4400, 6600 ] 30 0.024% 99.990% ( 6600, 9900 ] 11 0.009% 99.999% ( 9900, 14000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 457903 Average: 15.3296 StdDev: 182.40 Min: 1 Median: 2.1286 Max: 9340 Percentiles: P50: 2.13 P75: 3.24 P99: 13.89 P99.9: 2830.62 P99.99: 4238.11 ------------------------------------------------------ [ 0, 1 ] 7680 1.677% 1.677% ( 1, 2 ] 206034 44.995% 46.672% ######### ( 2, 3 ] 118523 25.884% 72.556% ##### ( 3, 4 ] 45807 10.004% 82.560% ## ( 4, 6 ] 58234 12.718% 95.277% ### ( 6, 10 ] 13928 3.042% 98.319% # ( 10, 15 ] 4007 0.875% 99.194% ( 15, 22 ] 494 0.108% 99.302% ( 22, 34 ] 67 0.015% 99.317% ( 34, 51 ] 40 0.009% 99.325% ( 51, 76 ] 46 0.010% 99.335% ( 76, 110 ] 16 0.003% 99.339% ( 110, 170 ] 37 0.008% 99.347% ( 170, 250 ] 78 0.017% 99.364% ( 250, 380 ] 115 0.025% 99.389% ( 380, 580 ] 256 0.056% 99.445% ( 580, 870 ] 412 0.090% 99.535% ( 870, 1300 ] 551 0.120% 99.655% ( 1300, 1900 ] 558 0.122% 99.777% ( 1900, 2900 ] 604 0.132% 99.909% ( 2900, 4400 ] 415 0.091% 100.000% ( 4400, 6600 ] 107 0.023% 100.023% ( 6600, 9900 ] 26 0.006% 100.029% ** Level 3 read latency histogram (micros): Count: 1391350 Average: 8.9334 StdDev: 124.90 Min: 1 Median: 2.0601 Max: 9571 Percentiles: P50: 2.06 P75: 3.11 P99: 9.92 P99.9: 790.29 P99.99: 1382.58 ------------------------------------------------------ [ 0, 1 ] 25503 1.833% 1.833% ( 1, 2 ] 648929 46.640% 48.473% ######### ( 2, 3 ] 353357 25.397% 73.870% ##### ( 3, 4 ] 138100 9.926% 83.796% ## ( 4, 6 ] 174974 12.576% 96.371% ### ( 6, 10 ] 37332 2.683% 99.055% # ( 10, 15 ] 8666 0.623% 99.677% ( 15, 22 ] 927 0.067% 99.744% ( 22, 34 ] 82 0.006% 99.750% ( 34, 51 ] 98 0.007% 99.757% ( 51, 76 ] 116 0.008% 99.765% ( 76, 110 ] 46 0.003% 99.769% ( 110, 170 ] 138 0.010% 99.778% ( 170, 250 ] 178 0.013% 99.791% ( 250, 380 ] 329 0.024% 99.815% ( 380, 580 ] 568 0.041% 99.856% ( 580, 870 ] 849 0.061% 99.917% ( 870, 1300 ] 906 0.065% 99.982% ( 1300, 1900 ] 820 0.059% 100.041% ( 1900, 2900 ] 722 0.052% 100.093% ( 2900, 4400 ] 556 0.040% 100.133% ( 4400, 6600 ] 180 0.013% 100.146% ( 6600, 9900 ] 38 0.003% 100.148% ** Level 4 read latency histogram (micros): Count: 879475 Average: 22.2030 StdDev: 212.58 Min: 1 Median: 2.0655 Max: 12741 Percentiles: P50: 2.07 P75: 3.20 P99: 473.24 P99.9: 2700.68 P99.99: 3641.55 ------------------------------------------------------ [ 0, 1 ] 16956 1.928% 1.928% ( 1, 2 ] 408602 46.460% 48.388% ######### ( 2, 3 ] 216477 24.614% 73.002% ##### ( 3, 4 ] 86204 9.802% 82.804% ## ( 4, 6 ] 107289 12.199% 95.003% ## ( 6, 10 ] 24082 2.738% 97.741% # ( 10, 15 ] 5950 0.677% 98.418% ( 15, 22 ] 565 0.064% 98.482% ( 22, 34 ] 45 0.005% 98.487% ( 34, 51 ] 72 0.008% 98.495% ( 51, 76 ] 84 0.010% 98.505% ( 76, 110 ] 164 0.019% 98.524% ( 110, 170 ] 1229 0.140% 98.663% ( 170, 250 ] 1171 0.133% 98.796% ( 250, 380 ] 1090 0.124% 98.920% ( 380, 580 ] 1502 0.171% 99.091% ( 580, 870 ] 2131 0.242% 99.333% ( 870, 1300 ] 2213 0.252% 99.585% ( 1300, 1900 ] 1687 0.192% 99.777% ( 1900, 2900 ] 1352 0.154% 99.931% ( 2900, 4400 ] 1056 0.120% 100.051% ( 4400, 6600 ] 323 0.037% 100.087% ( 6600, 9900 ] 37 0.004% 100.092% ( 9900, 14000 ] 1 0.000% 100.092% ** Level 5 read latency histogram (micros): Count: 44032 Average: 972.7545 StdDev: 1240.36 Min: 84 Median: 502.9679 Max: 12586 Percentiles: P50: 502.97 P75: 1172.68 P99: 6185.31 P99.9: 9341.98 P99.99: 11230.86 ------------------------------------------------------ ( 76, 110 ] 945 2.146% 2.146% ( 110, 170 ] 7878 17.892% 20.038% #### ( 170, 250 ] 5926 13.458% 33.496% ### ( 250, 380 ] 4143 9.409% 42.905% ## ( 380, 580 ] 5081 11.539% 54.444% ## ( 580, 870 ] 5630 12.786% 67.231% ### ( 870, 1300 ] 4860 11.037% 78.268% ## ( 1300, 1900 ] 3154 7.163% 85.431% # ( 1900, 2900 ] 2569 5.834% 91.265% # ( 2900, 4400 ] 2483 5.639% 96.905% # ( 4400, 6600 ] 1137 2.582% 99.487% # ( 6600, 9900 ] 219 0.497% 99.984% ( 9900, 14000 ] 8 0.018% 100.002% ** DB Stats ** Uptime(secs): 15.2 total, 4.6 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 129.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.295 H:M:S, 48.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 213.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.894 H:M:S, 19.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-12:43:57 ... thread 0: (1000000,3000000) ops and (284257.4,162451.4) ops/second in (3.517938,18.467064) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.77 GB 107.0 2.2 0.0 2.2 5.0 2.8 0.0 1.8 90.3 203.1 25.11 17.25 48 0.523 2302K 2420 0.0 0.0 L1 8/8 860.11 MB 0.0 1.1 0.7 0.4 1.1 0.7 0.0 1.6 89.8 89.4 12.56 5.42 1 12.556 1144K 4727 0.0 0.0 L2 1/0 72.43 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 987.08 MB 1.0 3.9 2.7 1.3 3.9 2.7 0.2 1.5 107.6 106.8 37.47 19.26 14 2.677 1682K 3181 0.0 0.0 L4 169/0 9.49 GB 1.0 8.1 4.7 3.4 8.0 4.6 0.3 1.7 124.4 122.6 66.47 38.65 46 1.445 3880K 1597 0.0 0.0 L5 1144/0 93.94 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1351/19 108.07 GB 0.0 15.3 8.1 7.2 17.9 10.7 5.7 6.5 110.9 129.8 141.61 80.59 109 1.299 9010K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.3 8.1 7.2 17.9 10.7 5.7 6.5 110.9 129.8 141.61 80.59 109 1.299 9010K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.3 8.1 7.2 15.2 7.9 0.0 0.0 123.4 122.2 127.18 72.46 69 1.843 9010K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 196.4 14.43 8.14 40 0.361 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.7 total, 18.5 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.95 GB write, 983.80 MB/s write, 15.33 GB read, 840.41 MB/s read, 141.6 seconds Interval compaction: 17.95 GB write, 995.12 MB/s write, 15.33 GB read, 850.08 MB/s read, 141.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 23, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 31, interval: 54 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1001312 Average: 12.2030 StdDev: 139.47 Min: 1 Median: 1.7081 Max: 10210 Percentiles: P50: 1.71 P75: 2.48 P99: 166.52 P99.9: 1813.59 P99.99: 3453.47 ------------------------------------------------------ [ 0, 1 ] 94149 9.403% 9.403% ## ( 1, 2 ] 574084 57.333% 66.736% ########### ( 2, 3 ] 173068 17.284% 84.020% ### ( 3, 4 ] 61705 6.162% 90.182% # ( 4, 6 ] 67325 6.724% 96.906% # ( 6, 10 ] 14575 1.456% 98.362% ( 10, 15 ] 2932 0.293% 98.654% ( 15, 22 ] 322 0.032% 98.687% ( 22, 34 ] 37 0.004% 98.690% ( 34, 51 ] 20 0.002% 98.692% ( 51, 76 ] 19 0.002% 98.694% ( 76, 110 ] 332 0.033% 98.727% ( 110, 170 ] 2899 0.290% 99.017% ( 170, 250 ] 2553 0.255% 99.272% ( 250, 380 ] 1529 0.153% 99.424% ( 380, 580 ] 1556 0.155% 99.580% ( 580, 870 ] 1451 0.145% 99.725% ( 870, 1300 ] 1105 0.110% 99.835% ( 1300, 1900 ] 759 0.076% 99.911% ( 1900, 2900 ] 600 0.060% 99.971% ( 2900, 4400 ] 520 0.052% 100.023% ( 4400, 6600 ] 140 0.014% 100.037% ( 6600, 9900 ] 21 0.002% 100.039% ( 9900, 14000 ] 2 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 156059 Average: 12.4363 StdDev: 147.64 Min: 1 Median: 2.1135 Max: 10745 Percentiles: P50: 2.11 P75: 3.15 P99: 162.18 P99.9: 2204.16 P99.99: 6335.57 ------------------------------------------------------ [ 0, 1 ] 2924 1.874% 1.874% ( 1, 2 ] 70391 45.105% 46.979% ######### ( 2, 3 ] 41555 26.628% 73.607% ##### ( 3, 4 ] 14632 9.376% 82.983% ## ( 4, 6 ] 18268 11.706% 94.689% ## ( 6, 10 ] 4760 3.050% 97.739% # ( 10, 15 ] 1237 0.793% 98.531% ( 15, 22 ] 135 0.087% 98.618% ( 22, 34 ] 12 0.008% 98.626% ( 34, 51 ] 12 0.008% 98.633% ( 51, 76 ] 17 0.011% 98.644% ( 76, 110 ] 91 0.058% 98.702% ( 110, 170 ] 534 0.342% 99.045% ( 170, 250 ] 425 0.272% 99.317% ( 250, 380 ] 206 0.132% 99.449% ( 380, 580 ] 205 0.131% 99.580% ( 580, 870 ] 202 0.129% 99.710% ( 870, 1300 ] 181 0.116% 99.826% ( 1300, 1900 ] 91 0.058% 99.884% ( 1900, 2900 ] 82 0.053% 99.937% ( 2900, 4400 ] 57 0.037% 99.973% ( 4400, 6600 ] 30 0.019% 99.992% ( 6600, 9900 ] 11 0.007% 99.999% ( 9900, 14000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 457954 Average: 15.3562 StdDev: 182.43 Min: 1 Median: 2.1288 Max: 9340 Percentiles: P50: 2.13 P75: 3.25 P99: 13.95 P99.9: 2830.54 P99.99: 4238.09 ------------------------------------------------------ [ 0, 1 ] 7680 1.677% 1.677% ( 1, 2 ] 206034 44.990% 46.667% ######### ( 2, 3 ] 118523 25.881% 72.548% ##### ( 3, 4 ] 45807 10.003% 82.551% ## ( 4, 6 ] 58234 12.716% 95.267% ### ( 6, 10 ] 13928 3.041% 98.308% # ( 10, 15 ] 4007 0.875% 99.183% ( 15, 22 ] 494 0.108% 99.291% ( 22, 34 ] 67 0.015% 99.306% ( 34, 51 ] 40 0.009% 99.314% ( 51, 76 ] 46 0.010% 99.324% ( 76, 110 ] 20 0.004% 99.329% ( 110, 170 ] 55 0.012% 99.341% ( 170, 250 ] 92 0.020% 99.361% ( 250, 380 ] 122 0.027% 99.387% ( 380, 580 ] 261 0.057% 99.444% ( 580, 870 ] 414 0.090% 99.535% ( 870, 1300 ] 551 0.120% 99.655% ( 1300, 1900 ] 559 0.122% 99.777% ( 1900, 2900 ] 604 0.132% 99.909% ( 2900, 4400 ] 415 0.091% 100.000% ( 4400, 6600 ] 107 0.023% 100.023% ( 6600, 9900 ] 26 0.006% 100.029% ** Level 3 read latency histogram (micros): Count: 1391954 Average: 9.0199 StdDev: 125.00 Min: 1 Median: 2.0610 Max: 9571 Percentiles: P50: 2.06 P75: 3.12 P99: 9.97 P99.9: 792.53 P99.99: 1383.27 ------------------------------------------------------ [ 0, 1 ] 25504 1.832% 1.832% ( 1, 2 ] 648932 46.620% 48.452% ######### ( 2, 3 ] 353390 25.388% 73.841% ##### ( 3, 4 ] 138123 9.923% 83.763% ## ( 4, 6 ] 174998 12.572% 96.336% ### ( 6, 10 ] 37335 2.682% 99.018% # ( 10, 15 ] 8666 0.623% 99.640% ( 15, 22 ] 928 0.067% 99.707% ( 22, 34 ] 82 0.006% 99.713% ( 34, 51 ] 98 0.007% 99.720% ( 51, 76 ] 116 0.008% 99.728% ( 76, 110 ] 69 0.005% 99.733% ( 110, 170 ] 334 0.024% 99.757% ( 170, 250 ] 324 0.023% 99.781% ( 250, 380 ] 409 0.029% 99.810% ( 380, 580 ] 615 0.044% 99.854% ( 580, 870 ] 872 0.063% 99.917% ( 870, 1300 ] 906 0.065% 99.982% ( 1300, 1900 ] 820 0.059% 100.041% ( 1900, 2900 ] 723 0.052% 100.093% ( 2900, 4400 ] 556 0.040% 100.133% ( 4400, 6600 ] 180 0.013% 100.146% ( 6600, 9900 ] 38 0.003% 100.148% ** Level 4 read latency histogram (micros): Count: 886138 Average: 23.6662 StdDev: 212.98 Min: 1 Median: 2.0807 Max: 12741 Percentiles: P50: 2.08 P75: 3.26 P99: 523.44 P99.9: 2696.80 P99.99: 3641.32 ------------------------------------------------------ [ 0, 1 ] 16956 1.913% 1.913% ( 1, 2 ] 408626 46.113% 48.027% ######### ( 2, 3 ] 216666 24.451% 72.477% ##### ( 3, 4 ] 86336 9.743% 82.220% ## ( 4, 6 ] 107553 12.137% 94.357% ## ( 6, 10 ] 24138 2.724% 97.081% # ( 10, 15 ] 5961 0.673% 97.754% ( 15, 22 ] 566 0.064% 97.818% ( 22, 34 ] 45 0.005% 97.823% ( 34, 51 ] 72 0.008% 97.831% ( 51, 76 ] 84 0.009% 97.841% ( 76, 110 ] 439 0.050% 97.890% ( 110, 170 ] 3517 0.397% 98.287% ( 170, 250 ] 2931 0.331% 98.618% ( 250, 380 ] 1874 0.211% 98.829% ( 380, 580 ] 2109 0.238% 99.067% ( 580, 870 ] 2354 0.266% 99.333% ( 870, 1300 ] 2253 0.254% 99.587% ( 1300, 1900 ] 1693 0.191% 99.778% ( 1900, 2900 ] 1354 0.153% 99.931% ( 2900, 4400 ] 1057 0.119% 100.050% ( 4400, 6600 ] 323 0.036% 100.087% ( 6600, 9900 ] 37 0.004% 100.091% ( 9900, 14000 ] 1 0.000% 100.091% ** Level 5 read latency histogram (micros): Count: 82106 Average: 632.4485 StdDev: 985.69 Min: 83 Median: 243.2154 Max: 12586 Percentiles: P50: 243.22 P75: 630.64 P99: 5448.61 P99.9: 8768.27 P99.99: 9881.76 ------------------------------------------------------ ( 76, 110 ] 2616 3.186% 3.186% # ( 110, 170 ] 22660 27.598% 30.785% ###### ( 170, 250 ] 17239 20.996% 51.781% #### ( 250, 380 ] 9027 10.994% 62.775% ## ( 380, 580 ] 8813 10.734% 73.509% ## ( 580, 870 ] 7013 8.541% 82.050% ## ( 870, 1300 ] 5120 6.236% 88.286% # ( 1300, 1900 ] 3178 3.871% 92.156% # ( 1900, 2900 ] 2589 3.153% 95.310% # ( 2900, 4400 ] 2488 3.030% 98.340% # ( 4400, 6600 ] 1137 1.385% 99.725% ( 6600, 9900 ] 219 0.267% 99.991% ( 9900, 14000 ] 8 0.010% 100.001% ** DB Stats ** Uptime(secs): 18.7 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 158.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.295 H:M:S, 39.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 279.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-12:44:02 ... thread 0: (1000000,4000000) ops and (205575.3,171442.3) ops/second in (4.864398,23.331462) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/7 3.81 GB 239.2 3.4 0.0 3.4 7.3 3.8 0.0 1.9 105.1 221.4 33.56 25.08 70 0.479 3582K 3638 0.0 0.0 L1 8/8 860.11 MB 0.0 1.1 0.7 0.4 1.1 0.7 0.0 1.6 89.8 89.4 12.56 5.42 1 12.556 1144K 4727 0.0 0.0 L2 1/0 72.43 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 987.08 MB 1.0 3.9 2.7 1.3 3.9 2.7 0.2 1.5 107.6 106.8 37.47 19.26 14 2.677 1682K 3181 0.0 0.0 L4 169/0 9.49 GB 1.0 8.1 4.7 3.4 8.0 4.6 0.3 1.7 124.4 122.6 66.47 38.65 46 1.445 3880K 1597 0.0 0.0 L5 1144/0 93.94 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1353/15 109.11 GB 0.0 16.6 8.1 8.5 20.2 11.7 5.7 5.3 113.0 138.0 150.06 88.41 131 1.145 10M 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.6 8.1 8.5 20.2 11.7 5.7 5.3 113.0 138.0 150.06 88.41 131 1.145 10M 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.6 8.1 8.5 16.4 7.9 0.0 0.0 128.4 127.2 132.11 77.30 74 1.785 10M 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 217.6 17.95 11.12 57 0.315 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.5 total, 23.3 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.22 GB write, 879.50 MB/s write, 16.56 GB read, 720.30 MB/s read, 150.1 seconds Interval compaction: 20.22 GB write, 887.51 MB/s write, 16.56 GB read, 726.86 MB/s read, 150.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 23, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 31, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1333196 Average: 13.6620 StdDev: 125.92 Min: 1 Median: 1.6549 Max: 10210 Percentiles: P50: 1.65 P75: 2.35 P99: 236.34 P99.9: 1423.72 P99.99: 2850.78 ------------------------------------------------------ [ 0, 1 ] 166032 12.454% 12.454% ## ( 1, 2 ] 764369 57.334% 69.787% ########### ( 2, 3 ] 200042 15.005% 84.792% ### ( 3, 4 ] 70357 5.277% 90.069% # ( 4, 6 ] 74256 5.570% 95.639% # ( 6, 10 ] 15791 1.184% 96.823% ( 10, 15 ] 3334 0.250% 97.074% ( 15, 22 ] 389 0.029% 97.103% ( 22, 34 ] 49 0.004% 97.106% ( 34, 51 ] 22 0.002% 97.108% ( 51, 76 ] 20 0.002% 97.110% ( 76, 110 ] 1428 0.107% 97.217% ( 110, 170 ] 14634 1.098% 98.314% ( 170, 250 ] 11026 0.827% 99.141% ( 250, 380 ] 3797 0.285% 99.426% ( 380, 580 ] 3033 0.227% 99.654% ( 580, 870 ] 1951 0.146% 99.800% ( 870, 1300 ] 1174 0.088% 99.888% ( 1300, 1900 ] 775 0.058% 99.946% ( 1900, 2900 ] 616 0.046% 99.992% ( 2900, 4400 ] 536 0.040% 100.033% ( 4400, 6600 ] 140 0.011% 100.043% ( 6600, 9900 ] 21 0.002% 100.045% ( 9900, 14000 ] 2 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 168768 Average: 13.5392 StdDev: 143.53 Min: 1 Median: 2.1892 Max: 10745 Percentiles: P50: 2.19 P75: 3.35 P99: 214.84 P99.9: 2047.37 P99.99: 6169.03 ------------------------------------------------------ [ 0, 1 ] 3041 1.802% 1.802% ( 1, 2 ] 72885 43.187% 44.988% ######### ( 2, 3 ] 44710 26.492% 71.480% ##### ( 3, 4 ] 16833 9.974% 81.454% ## ( 4, 6 ] 20740 12.289% 93.743% ## ( 6, 10 ] 5274 3.125% 96.868% # ( 10, 15 ] 1401 0.830% 97.699% ( 15, 22 ] 212 0.126% 97.824% ( 22, 34 ] 24 0.014% 97.838% ( 34, 51 ] 12 0.007% 97.846% ( 51, 76 ] 17 0.010% 97.856% ( 76, 110 ] 165 0.098% 97.953% ( 110, 170 ] 1268 0.751% 98.705% ( 170, 250 ] 889 0.527% 99.231% ( 250, 380 ] 334 0.198% 99.429% ( 380, 580 ] 286 0.169% 99.599% ( 580, 870 ] 221 0.131% 99.730% ( 870, 1300 ] 184 0.109% 99.839% ( 1300, 1900 ] 91 0.054% 99.893% ( 1900, 2900 ] 83 0.049% 99.942% ( 2900, 4400 ] 57 0.034% 99.976% ( 4400, 6600 ] 30 0.018% 99.993% ( 6600, 9900 ] 11 0.007% 100.000% ( 9900, 14000 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 458054 Average: 15.3956 StdDev: 182.43 Min: 1 Median: 2.1292 Max: 9340 Percentiles: P50: 2.13 P75: 3.25 P99: 14.08 P99.9: 2830.37 P99.99: 4238.05 ------------------------------------------------------ [ 0, 1 ] 7680 1.677% 1.677% ( 1, 2 ] 206034 44.980% 46.657% ######### ( 2, 3 ] 118523 25.875% 72.532% ##### ( 3, 4 ] 45807 10.000% 82.533% ## ( 4, 6 ] 58234 12.713% 95.246% ### ( 6, 10 ] 13928 3.041% 98.287% # ( 10, 15 ] 4007 0.875% 99.161% ( 15, 22 ] 494 0.108% 99.269% ( 22, 34 ] 67 0.015% 99.284% ( 34, 51 ] 40 0.009% 99.293% ( 51, 76 ] 46 0.010% 99.303% ( 76, 110 ] 25 0.005% 99.308% ( 110, 170 ] 97 0.021% 99.329% ( 170, 250 ] 132 0.029% 99.358% ( 250, 380 ] 129 0.028% 99.386% ( 380, 580 ] 265 0.058% 99.444% ( 580, 870 ] 416 0.091% 99.535% ( 870, 1300 ] 551 0.120% 99.655% ( 1300, 1900 ] 559 0.122% 99.777% ( 1900, 2900 ] 604 0.132% 99.909% ( 2900, 4400 ] 415 0.091% 100.000% ( 4400, 6600 ] 107 0.023% 100.023% ( 6600, 9900 ] 26 0.006% 100.029% ** Level 3 read latency histogram (micros): Count: 1392919 Average: 9.1549 StdDev: 125.15 Min: 1 Median: 2.0623 Max: 9571 Percentiles: P50: 2.06 P75: 3.12 P99: 10.38 P99.9: 797.04 P99.99: 1384.56 ------------------------------------------------------ [ 0, 1 ] 25504 1.831% 1.831% ( 1, 2 ] 648934 46.588% 48.419% ######### ( 2, 3 ] 353407 25.372% 73.791% ##### ( 3, 4 ] 138137 9.917% 83.708% ## ( 4, 6 ] 175019 12.565% 96.273% ### ( 6, 10 ] 37335 2.680% 98.953% # ( 10, 15 ] 8666 0.622% 99.575% ( 15, 22 ] 928 0.067% 99.642% ( 22, 34 ] 82 0.006% 99.648% ( 34, 51 ] 98 0.007% 99.655% ( 51, 76 ] 116 0.008% 99.663% ( 76, 110 ] 103 0.007% 99.670% ( 110, 170 ] 762 0.055% 99.725% ( 170, 250 ] 613 0.044% 99.769% ( 250, 380 ] 487 0.035% 99.804% ( 380, 580 ] 660 0.047% 99.852% ( 580, 870 ] 902 0.065% 99.916% ( 870, 1300 ] 911 0.065% 99.982% ( 1300, 1900 ] 821 0.059% 100.041% ( 1900, 2900 ] 724 0.052% 100.093% ( 2900, 4400 ] 556 0.040% 100.133% ( 4400, 6600 ] 180 0.013% 100.145% ( 6600, 9900 ] 38 0.003% 100.148% ** Level 4 read latency histogram (micros): Count: 896461 Average: 25.6884 StdDev: 212.98 Min: 1 Median: 2.1044 Max: 12741 Percentiles: P50: 2.10 P75: 3.35 P99: 542.96 P99.9: 2689.33 P99.99: 3639.86 ------------------------------------------------------ [ 0, 1 ] 16956 1.891% 1.891% ( 1, 2 ] 408639 45.584% 47.475% ######### ( 2, 3 ] 216728 24.176% 71.651% ##### ( 3, 4 ] 86368 9.634% 81.285% ## ( 4, 6 ] 107613 12.004% 93.290% ## ( 6, 10 ] 24149 2.694% 95.983% # ( 10, 15 ] 5963 0.665% 96.648% ( 15, 22 ] 567 0.063% 96.712% ( 22, 34 ] 45 0.005% 96.717% ( 34, 51 ] 72 0.008% 96.725% ( 51, 76 ] 84 0.009% 96.734% ( 76, 110 ] 895 0.100% 96.834% ( 110, 170 ] 8334 0.930% 97.764% ( 170, 250 ] 6158 0.687% 98.451% ( 250, 380 ] 2732 0.305% 98.755% ( 380, 580 ] 2692 0.300% 99.056% ( 580, 870 ] 2515 0.281% 99.336% ( 870, 1300 ] 2289 0.255% 99.592% ( 1300, 1900 ] 1696 0.189% 99.781% ( 1900, 2900 ] 1355 0.151% 99.932% ( 2900, 4400 ] 1057 0.118% 100.050% ( 4400, 6600 ] 323 0.036% 100.086% ( 6600, 9900 ] 37 0.004% 100.090% ( 9900, 14000 ] 1 0.000% 100.090% ** Level 5 read latency histogram (micros): Count: 140979 Average: 453.4612 StdDev: 786.32 Min: 82 Median: 202.3503 Max: 12586 Percentiles: P50: 202.35 P75: 378.86 P99: 4372.56 P99.9: 7896.21 P99.99: 9808.11 ------------------------------------------------------ ( 76, 110 ] 5250 3.724% 3.724% # ( 110, 170 ] 50622 35.907% 39.631% ####### ( 170, 250 ] 36148 25.641% 65.272% ##### ( 250, 380 ] 13836 9.814% 75.086% ## ( 380, 580 ] 12156 8.623% 83.709% ## ( 580, 870 ] 8018 5.687% 89.396% # ( 870, 1300 ] 5257 3.729% 93.125% # ( 1300, 1900 ] 3207 2.275% 95.400% ( 1900, 2900 ] 2618 1.857% 97.257% ( 2900, 4400 ] 2503 1.775% 99.032% ( 4400, 6600 ] 1137 0.807% 99.839% ( 6600, 9900 ] 219 0.155% 99.994% ( 9900, 14000 ] 8 0.006% 100.000% ** DB Stats ** Uptime(secs): 23.5 total, 4.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 167.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.671 H:M:S, 36.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 202.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.376 H:M:S, 28.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 279.925 micros/op 14280 ops/sec 60.151 seconds 858996 operations; 13.8 MB/s (218999 of 218999 found) Microseconds per read: Count: 858996 Average: 279.9272 StdDev: 844.29 Min: 2 Median: 201.5218 Max: 70336 Percentiles: P50: 201.52 P75: 246.08 P99: 1437.76 P99.9: 15943.55 P99.99: 32069.90 ------------------------------------------------------ ( 1, 2 ] 7 0.001% 0.001% ( 2, 3 ] 35 0.004% 0.005% ( 3, 4 ] 41 0.005% 0.010% ( 4, 6 ] 67 0.008% 0.017% ( 6, 10 ] 310 0.036% 0.054% ( 10, 15 ] 1758 0.205% 0.258% ( 15, 22 ] 1652 0.192% 0.451% ( 22, 34 ] 4563 0.531% 0.982% ( 34, 51 ] 1471 0.171% 1.153% ( 51, 76 ] 234 0.027% 1.180% ( 76, 110 ] 3471 0.404% 1.584% ( 110, 170 ] 263977 30.731% 32.315% ###### ( 170, 250 ] 385541 44.883% 77.198% ######### ( 250, 380 ] 109615 12.761% 89.959% ### ( 380, 580 ] 51960 6.049% 96.008% # ( 580, 870 ] 17778 2.070% 98.077% ( 870, 1300 ] 7181 0.836% 98.913% ( 1300, 1900 ] 3245 0.378% 99.291% ( 1900, 2900 ] 2264 0.264% 99.555% ( 2900, 4400 ] 1883 0.219% 99.774% ( 4400, 6600 ] 581 0.068% 99.841% ( 6600, 9900 ] 119 0.014% 99.855% ( 9900, 14000 ] 212 0.025% 99.880% ( 14000, 22000 ] 708 0.082% 99.962% ( 22000, 33000 ] 259 0.030% 99.993% ( 33000, 50000 ] 47 0.005% 99.998% ( 50000, 75000 ] 17 0.002% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 14135615 rocksdb.bloom.filter.full.positive COUNT : 996829 rocksdb.bloom.filter.full.true.positive COUNT : 858634 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 362 rocksdb.memtable.miss COUNT : 858634 rocksdb.l0.hit COUNT : 33997 rocksdb.l1.hit COUNT : 7202 rocksdb.l2andup.hit COUNT : 817435 rocksdb.compaction.key.drop.new COUNT : 193074 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4504378 rocksdb.number.keys.read COUNT : 858996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4648518096 rocksdb.bytes.read COUNT : 858996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1631 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 42790085 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 22421439795 rocksdb.compact.write.bytes COUNT : 22225286991 rocksdb.flush.write.bytes COUNT : 4624144118 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 38 rocksdb.number.superversion_acquires COUNT : 945 rocksdb.number.superversion_releases COUNT : 922 rocksdb.number.superversion_cleanups COUNT : 235 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 229 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4586797056 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1735680 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 25678203716 rocksdb.non.last.level.read.count COUNT : 6063069 rocksdb.block.checksum.compute.count COUNT : 6438759 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 200.539966 P95 : 545.834904 P99 : 1436.631904 P100 : 70333.000000 COUNT : 858996 SUM : 239666564 rocksdb.db.write.micros P50 : 1.560529 P95 : 4.684355 P99 : 11.081369 P100 : 711560.000000 COUNT : 4504378 SUM : 54210070 rocksdb.compaction.times.micros P50 : 1413888.888889 P95 : 3110000.000000 P99 : 12383000.000000 P100 : 12555706.000000 COUNT : 77 SUM : 140103970 rocksdb.compaction.times.cpu_micros P50 : 929259.259259 P95 : 1857500.000000 P99 : 5935333.333333 P100 : 5935626.000000 COUNT : 77 SUM : 85122172 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 839.242424 P95 : 26125.000000 P99 : 38866.000000 P100 : 38866.000000 COUNT : 65 SUM : 248185 rocksdb.compaction.outfile.sync.micros P50 : 19523.809524 P95 : 220857.142857 P99 : 371712.500000 P100 : 403332.000000 COUNT : 251 SUM : 13685849 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 358.333333 P95 : 4372.727273 P99 : 7194.000000 P100 : 7895.000000 COUNT : 164 SUM : 182874 rocksdb.table.open.io.micros P50 : 11494.444444 P95 : 21311.009174 P99 : 28922.500000 P100 : 31590.000000 COUNT : 1631 SUM : 18104591 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.048229 P95 : 11.949999 P99 : 220.186791 P100 : 14625.000000 COUNT : 5430799 SUM : 91704934 rocksdb.read.block.get.micros P50 : 156.033742 P95 : 406.687549 P99 : 1440.318650 P100 : 20750.000000 COUNT : 1006341 SUM : 207070014 rocksdb.write.raw.block.micros P50 : 0.547019 P95 : 1.614515 P99 : 3.681004 P100 : 15450.000000 COUNT : 6503200 SUM : 19485756 rocksdb.numfiles.in.singlecompaction P50 : 3.060976 P95 : 5.737500 P99 : 9.986667 P100 : 15.000000 COUNT : 101 SUM : 369 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.570033 P95 : 1953.902152 P99 : 2730.169108 P100 : 711362.000000 COUNT : 214599 SUM : 42808848 rocksdb.sst.read.micros P50 : 2.202145 P95 : 200.761192 P99 : 496.061845 P100 : 12741.000000 COUNT : 6063136 SUM : 280111133 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 858996 SUM : 858996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4504378 SUM : 4648518096 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 224166.666667 P95 : 841875.000000 P99 : 1126333.333333 P100 : 1162701.000000 COUNT : 65 SUM : 19606618 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 289 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0