[2024-07-15 08:53:27.901783] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... [2024-07-15 08:53:27.901892] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3002692 ] Set seed to 1721026407899498 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 08:53:28.001839] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 08:53:28.218401] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 08:53:28.218439] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3002692' to capture a snapshot of events at runtime. [2024-07-15 08:53:28.218450] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3002692 for offline analysis/debug. [2024-07-15 08:53:28.218498] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 08:53:37 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/15-08:53:40 ... thread 0: (1000000,1000000) ops and (365246.6,365246.6) ops/second in (2.737876,2.737876) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 504.02 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 359.5 2.28 2.03 12 0.190 0 0 0.0 0.0 L1 3/3 188.88 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 255.2 255.1 0.74 0.71 1 0.741 191K 73 0.0 0.0 L2 2/1 125.95 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 236.2 236.1 0.53 0.51 1 0.533 127K 47 0.0 0.0 L3 9/0 741.26 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/12 96.94 GB 0.0 0.3 0.2 0.1 1.1 1.0 0.4 1.4 88.7 319.2 3.55 3.24 14 0.254 319K 120 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.1 1.0 0.3 1.4 88.7 319.2 3.55 3.24 14 0.254 319K 120 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 247.2 247.1 1.27 1.22 2 0.637 319K 120 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 359.5 2.28 2.03 12 0.190 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.7 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 379.29 MB/s write, 0.31 GB read, 105.36 MB/s read, 3.6 seconds Interval compaction: 1.11 GB write, 413.85 MB/s write, 0.31 GB read, 114.96 MB/s read, 3.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 114801 Average: 2.0869 StdDev: 27.31 Min: 1 Median: 1.2960 Max: 3900 Percentiles: P50: 1.30 P75: 1.70 P99: 4.75 P99.9: 11.74 P99.99: 155.12 ------------------------------------------------------ [ 0, 1 ] 36431 31.734% 31.734% ###### ( 1, 2 ] 70837 61.704% 93.438% ############ ( 2, 3 ] 4110 3.580% 97.018% # ( 3, 4 ] 1897 1.652% 98.671% ( 4, 6 ] 1011 0.881% 99.551% ( 6, 10 ] 367 0.320% 99.871% ( 10, 15 ] 104 0.091% 99.962% ( 15, 22 ] 19 0.017% 99.978% ( 22, 34 ] 4 0.003% 99.982% ( 34, 51 ] 3 0.003% 99.984% ( 51, 76 ] 1 0.001% 99.985% ( 76, 110 ] 1 0.001% 99.986% ( 110, 170 ] 10 0.009% 99.995% ( 170, 250 ] 1 0.001% 99.996% ( 250, 380 ] 1 0.001% 99.997% ( 580, 870 ] 2 0.002% 99.998% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ( 1900, 2900 ] 3 0.003% 100.003% ( 2900, 4400 ] 5 0.004% 100.007% ** Level 1 read latency histogram (micros): Count: 21806 Average: 2.5432 StdDev: 60.80 Min: 1 Median: 1.3200 Max: 8129 Percentiles: P50: 1.32 P75: 1.70 P99: 4.36 P99.9: 12.28 P99.99: 1222.34 ------------------------------------------------------ [ 0, 1 ] 6358 29.157% 29.157% ###### ( 1, 2 ] 14204 65.138% 94.295% ############# ( 2, 3 ] 674 3.091% 97.386% # ( 3, 4 ] 319 1.463% 98.849% ( 4, 6 ] 181 0.830% 99.679% ( 6, 10 ] 40 0.183% 99.862% ( 10, 15 ] 18 0.083% 99.945% ( 15, 22 ] 2 0.009% 99.954% ( 51, 76 ] 1 0.005% 99.959% ( 170, 250 ] 1 0.005% 99.963% ( 380, 580 ] 2 0.009% 99.972% ( 580, 870 ] 3 0.014% 99.986% ( 870, 1300 ] 1 0.005% 99.991% ( 2900, 4400 ] 1 0.005% 99.995% ( 6600, 9900 ] 1 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 6202 Average: 2.5937 StdDev: 12.57 Min: 1 Median: 1.5916 Max: 890 Percentiles: P50: 1.59 P75: 1.99 P99: 7.51 P99.9: 14.57 P99.99: 890.00 ------------------------------------------------------ [ 0, 1 ] 808 13.028% 13.028% ### ( 1, 2 ] 3877 62.512% 75.540% ############# ( 2, 3 ] 718 11.577% 87.117% ## ( 3, 4 ] 394 6.353% 93.470% # ( 4, 6 ] 318 5.127% 98.597% # ( 6, 10 ] 69 1.113% 99.710% ( 10, 15 ] 14 0.226% 99.936% ( 15, 22 ] 1 0.016% 99.952% ( 22, 34 ] 1 0.016% 99.968% ( 34, 51 ] 1 0.016% 99.984% ( 380, 580 ] 1 0.016% 100.000% ( 870, 1300 ] 1 0.016% 100.016% ** Level 3 read latency histogram (micros): Count: 40 Average: 3482.2000 StdDev: 3242.00 Min: 302 Median: 870.0000 Max: 9217 Percentiles: P50: 870.00 P75: 7150.00 P99: 9217.00 P99.9: 9217.00 P99.99: 9217.00 ------------------------------------------------------ ( 250, 380 ] 2 5.000% 5.000% # ( 380, 580 ] 9 22.500% 27.500% ##### ( 580, 870 ] 9 22.500% 50.000% ##### ( 1900, 2900 ] 3 7.500% 57.500% ## ( 4400, 6600 ] 5 12.500% 70.000% ### ( 6600, 9900 ] 12 30.000% 100.000% ###### ** Level 4 read latency histogram (micros): Count: 35 Average: 4397.1429 StdDev: 3184.38 Min: 507 Median: 4557.1429 Max: 9994 Percentiles: P50: 4557.14 P75: 7342.50 P99: 9994.00 P99.9: 9994.00 P99.99: 9994.00 ------------------------------------------------------ ( 380, 580 ] 2 5.714% 5.714% # ( 580, 870 ] 7 20.000% 25.714% #### ( 870, 1300 ] 2 5.714% 31.429% # ( 1300, 1900 ] 2 5.714% 37.143% # ( 1900, 2900 ] 3 8.571% 45.714% ## ( 2900, 4400 ] 1 2.857% 48.571% # ( 4400, 6600 ] 7 20.000% 68.571% #### ( 6600, 9900 ] 10 28.571% 97.143% ###### ( 9900, 14000 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 329.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.192 H:M:S, 6.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 359.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.192 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/15-08:53:43 ... thread 0: (1000000,2000000) ops and (333586.3,348699.3) ops/second in (2.997725,5.735601) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 1.23 GB 6.3 0.2 0.0 0.2 2.0 1.8 0.0 1.1 41.9 345.9 6.01 5.43 27 0.223 255K 269 0.0 0.0 L1 5/5 440.11 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 247.3 247.0 2.55 2.47 2 1.273 639K 810 0.0 0.0 L2 1/0 992.19 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 236.2 236.1 0.53 0.51 1 0.533 127K 47 0.0 0.0 L3 17/0 866.25 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 212.1 212.1 0.59 0.52 1 0.589 126K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1198/19 97.92 GB 0.0 1.1 0.6 0.5 2.9 2.4 0.4 1.6 117.0 305.7 9.68 8.93 31 0.312 1150K 1126 0.0 0.0 Int 0/0 0.00 KB 0.0 1.1 0.6 0.5 2.9 2.4 0.3 1.6 117.0 305.7 9.68 8.93 31 0.312 1150K 1126 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.1 0.6 0.5 1.1 0.6 0.0 0.0 245.6 245.4 4.61 4.42 5 0.922 1150K 1126 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 360.5 5.07 4.50 26 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.7 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.89 GB write, 494.16 MB/s write, 1.11 GB read, 189.22 MB/s read, 9.7 seconds Interval compaction: 2.89 GB write, 515.66 MB/s write, 1.11 GB read, 197.45 MB/s read, 9.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 365810 Average: 2.1913 StdDev: 18.48 Min: 1 Median: 1.4559 Max: 4145 Percentiles: P50: 1.46 P75: 1.84 P99: 5.55 P99.9: 10.06 P99.99: 14.71 ------------------------------------------------------ [ 0, 1 ] 72946 19.941% 19.941% #### ( 1, 2 ] 241208 65.938% 85.879% ############# ( 2, 3 ] 31227 8.536% 94.415% ## ( 3, 4 ] 10728 2.933% 97.348% # ( 4, 6 ] 7784 2.128% 99.476% ( 6, 10 ] 1550 0.424% 99.900% ( 10, 15 ] 354 0.097% 99.996% ( 15, 22 ] 41 0.011% 100.008% ( 22, 34 ] 4 0.001% 100.009% ( 34, 51 ] 6 0.002% 100.010% ( 51, 76 ] 4 0.001% 100.011% ( 76, 110 ] 1 0.000% 100.012% ( 110, 170 ] 18 0.005% 100.017% ( 170, 250 ] 3 0.001% 100.017% ( 250, 380 ] 4 0.001% 100.019% ( 380, 580 ] 9 0.002% 100.021% ( 580, 870 ] 6 0.002% 100.023% ( 870, 1300 ] 2 0.001% 100.023% ( 1300, 1900 ] 1 0.000% 100.024% ( 1900, 2900 ] 4 0.001% 100.025% ( 2900, 4400 ] 7 0.002% 100.027% ** Level 1 read latency histogram (micros): Count: 95517 Average: 2.2492 StdDev: 29.83 Min: 1 Median: 1.4548 Max: 8129 Percentiles: P50: 1.45 P75: 1.83 P99: 5.43 P99.9: 10.92 P99.99: 524.83 ------------------------------------------------------ [ 0, 1 ] 18672 19.548% 19.548% #### ( 1, 2 ] 63959 66.961% 86.509% ############# ( 2, 3 ] 7929 8.301% 94.810% ## ( 3, 4 ] 2625 2.748% 97.559% # ( 4, 6 ] 1932 2.023% 99.581% ( 6, 10 ] 289 0.303% 99.884% ( 10, 15 ] 84 0.088% 99.972% ( 15, 22 ] 8 0.008% 99.980% ( 51, 76 ] 2 0.002% 99.982% ( 110, 170 ] 1 0.001% 99.983% ( 170, 250 ] 2 0.002% 99.985% ( 250, 380 ] 3 0.003% 99.988% ( 380, 580 ] 2 0.002% 99.991% ( 580, 870 ] 4 0.004% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31737 Average: 2.3783 StdDev: 5.65 Min: 1 Median: 1.5956 Max: 890 Percentiles: P50: 1.60 P75: 1.99 P99: 5.96 P99.9: 11.17 P99.99: 31.92 ------------------------------------------------------ [ 0, 1 ] 3933 12.392% 12.392% ## ( 1, 2 ] 20040 63.144% 75.536% ############# ( 2, 3 ] 4104 12.931% 88.468% ### ( 3, 4 ] 1839 5.794% 94.262% # ( 4, 6 ] 1532 4.827% 99.089% # ( 6, 10 ] 250 0.788% 99.877% ( 10, 15 ] 31 0.098% 99.975% ( 15, 22 ] 4 0.013% 99.987% ( 22, 34 ] 1 0.003% 99.991% ( 34, 51 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1758.5500 StdDev: 2870.14 Min: 1 Median: 380.0000 Max: 9217 Percentiles: P50: 380.00 P75: 1300.00 P99: 9217.00 P99.9: 9217.00 P99.99: 9217.00 ------------------------------------------------------ [ 0, 1 ] 4 5.000% 5.000% # ( 1, 2 ] 26 32.500% 37.500% ####### ( 2, 3 ] 2 2.500% 40.000% # ( 3, 4 ] 4 5.000% 45.000% # ( 4, 6 ] 1 1.250% 46.250% ( 6, 10 ] 1 1.250% 47.500% ( 250, 380 ] 2 2.500% 50.000% # ( 380, 580 ] 10 12.500% 62.500% ### ( 580, 870 ] 9 11.250% 73.750% ## ( 870, 1300 ] 1 1.250% 75.000% ( 1900, 2900 ] 3 3.750% 78.750% # ( 4400, 6600 ] 5 6.250% 85.000% # ( 6600, 9900 ] 12 15.000% 100.000% ### ** Level 4 read latency histogram (micros): Count: 35 Average: 4397.1429 StdDev: 3184.38 Min: 507 Median: 4557.1429 Max: 9994 Percentiles: P50: 4557.14 P75: 7342.50 P99: 9994.00 P99.9: 9994.00 P99.99: 9994.00 ------------------------------------------------------ ( 380, 580 ] 2 5.714% 5.714% # ( 580, 870 ] 7 20.000% 25.714% #### ( 870, 1300 ] 2 5.714% 31.429% # ( 1300, 1900 ] 2 5.714% 37.143% # ( 1900, 2900 ] 3 8.571% 45.714% ## ( 2900, 4400 ] 1 2.857% 48.571% # ( 4400, 6600 ] 7 20.000% 68.571% #### ( 6600, 9900 ] 10 28.571% 97.143% ###### ( 9900, 14000 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 6.0 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 328.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.577 H:M:S, 9.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.386 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/15-08:53:46 ... thread 0: (1000000,3000000) ops and (328713.1,341772.5) ops/second in (3.042167,8.777768) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.60 GB 132.2 1.3 0.0 1.3 4.1 2.8 0.0 1.5 102.9 323.2 12.86 11.87 45 0.286 1343K 1410 0.0 0.0 L1 9/0 1.04 GB 106.5 1.7 1.0 0.6 1.7 1.0 0.1 1.6 237.4 236.6 7.16 6.95 3 2.386 1725K 5308 0.0 0.0 L2 1/0 992.19 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 236.2 236.1 0.53 0.51 1 0.533 127K 47 0.0 0.0 L3 17/0 866.25 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 212.1 212.1 0.59 0.52 1 0.589 126K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1198/4 98.90 GB 0.0 3.2 1.2 2.0 6.0 4.0 0.4 2.2 154.8 288.6 21.14 19.85 50 0.423 3323K 6765 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 1.2 2.0 6.0 4.0 0.3 2.2 154.8 288.6 21.14 19.85 50 0.423 3323K 6765 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 1.2 2.0 3.2 1.2 0.0 0.0 246.9 246.4 13.26 12.84 10 1.326 3323K 6765 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 359.7 7.88 7.01 40 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.96 GB write, 675.74 MB/s write, 3.20 GB read, 362.56 MB/s read, 21.1 seconds Interval compaction: 5.96 GB write, 694.95 MB/s write, 3.20 GB read, 372.86 MB/s read, 21.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 673002 Average: 2.2044 StdDev: 15.75 Min: 1 Median: 1.4816 Max: 4145 Percentiles: P50: 1.48 P75: 1.85 P99: 5.60 P99.9: 9.99 P99.99: 14.56 ------------------------------------------------------ [ 0, 1 ] 118315 17.580% 17.580% #### ( 1, 2 ] 453021 67.313% 84.894% ############# ( 2, 3 ] 62523 9.290% 94.184% ## ( 3, 4 ] 20466 3.041% 97.225% # ( 4, 6 ] 14965 2.224% 99.448% ( 6, 10 ] 3052 0.453% 99.902% ( 10, 15 ] 652 0.097% 99.999% ( 15, 22 ] 70 0.010% 100.009% ( 22, 34 ] 8 0.001% 100.010% ( 34, 51 ] 9 0.001% 100.012% ( 51, 76 ] 5 0.001% 100.012% ( 76, 110 ] 2 0.000% 100.013% ( 110, 170 ] 25 0.004% 100.016% ( 170, 250 ] 7 0.001% 100.018% ( 250, 380 ] 8 0.001% 100.019% ( 380, 580 ] 13 0.002% 100.021% ( 580, 870 ] 12 0.002% 100.022% ( 870, 1300 ] 9 0.001% 100.024% ( 1300, 1900 ] 2 0.000% 100.024% ( 1900, 2900 ] 6 0.001% 100.025% ( 2900, 4400 ] 8 0.001% 100.026% ** Level 1 read latency histogram (micros): Count: 159778 Average: 2.3168 StdDev: 25.41 Min: 1 Median: 1.4948 Max: 8129 Percentiles: P50: 1.49 P75: 1.86 P99: 5.51 P99.9: 11.47 P99.99: 654.11 ------------------------------------------------------ [ 0, 1 ] 25839 16.172% 16.172% ### ( 1, 2 ] 109238 68.369% 84.540% ############## ( 2, 3 ] 15708 9.831% 94.372% ## ( 3, 4 ] 4669 2.922% 97.294% # ( 4, 6 ] 3604 2.256% 99.549% ( 6, 10 ] 514 0.322% 99.871% ( 10, 15 ] 157 0.098% 99.969% ( 15, 22 ] 10 0.006% 99.976% ( 22, 34 ] 2 0.001% 99.977% ( 34, 51 ] 1 0.001% 99.977% ( 51, 76 ] 2 0.001% 99.979% ( 110, 170 ] 2 0.001% 99.980% ( 170, 250 ] 2 0.001% 99.981% ( 250, 380 ] 8 0.005% 99.986% ( 380, 580 ] 5 0.003% 99.989% ( 580, 870 ] 4 0.003% 99.992% ( 870, 1300 ] 4 0.003% 99.994% ( 1300, 1900 ] 7 0.004% 99.999% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31737 Average: 2.3783 StdDev: 5.65 Min: 1 Median: 1.5956 Max: 890 Percentiles: P50: 1.60 P75: 1.99 P99: 5.96 P99.9: 11.17 P99.99: 31.92 ------------------------------------------------------ [ 0, 1 ] 3933 12.392% 12.392% ## ( 1, 2 ] 20040 63.144% 75.536% ############# ( 2, 3 ] 4104 12.931% 88.468% ### ( 3, 4 ] 1839 5.794% 94.262% # ( 4, 6 ] 1532 4.827% 99.089% # ( 6, 10 ] 250 0.788% 99.877% ( 10, 15 ] 31 0.098% 99.975% ( 15, 22 ] 4 0.013% 99.987% ( 22, 34 ] 1 0.003% 99.991% ( 34, 51 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1758.5500 StdDev: 2870.14 Min: 1 Median: 380.0000 Max: 9217 Percentiles: P50: 380.00 P75: 1300.00 P99: 9217.00 P99.9: 9217.00 P99.99: 9217.00 ------------------------------------------------------ [ 0, 1 ] 4 5.000% 5.000% # ( 1, 2 ] 26 32.500% 37.500% ####### ( 2, 3 ] 2 2.500% 40.000% # ( 3, 4 ] 4 5.000% 45.000% # ( 4, 6 ] 1 1.250% 46.250% ( 6, 10 ] 1 1.250% 47.500% ( 250, 380 ] 2 2.500% 50.000% # ( 380, 580 ] 10 12.500% 62.500% ### ( 580, 870 ] 9 11.250% 73.750% ## ( 870, 1300 ] 1 1.250% 75.000% ( 1900, 2900 ] 3 3.750% 78.750% # ( 4400, 6600 ] 5 6.250% 85.000% # ( 6600, 9900 ] 12 15.000% 100.000% ### ** Level 4 read latency histogram (micros): Count: 35 Average: 4397.1429 StdDev: 3184.38 Min: 507 Median: 4557.1429 Max: 9994 Percentiles: P50: 4557.14 P75: 7342.50 P99: 9994.00 P99.9: 9994.00 P99.99: 9994.00 ------------------------------------------------------ ( 380, 580 ] 2 5.714% 5.714% # ( 580, 870 ] 7 20.000% 25.714% #### ( 870, 1300 ] 2 5.714% 31.429% # ( 1300, 1900 ] 2 5.714% 37.143% # ( 1900, 2900 ] 3 8.571% 45.714% ## ( 2900, 4400 ] 1 2.857% 48.571% # ( 4400, 6600 ] 7 20.000% 68.571% #### ( 6600, 9900 ] 10 28.571% 97.143% ###### ( 9900, 14000 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.991 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.413 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/15-08:53:49 ... thread 0: (1000000,4000000) ops and (338755.3,341013.2) ops/second in (2.951983,11.729751) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 2.58 GB 6.3 2.4 0.0 2.4 6.1 3.7 0.0 1.6 124.0 317.7 19.82 18.45 63 0.315 2494K 2589 0.0 0.0 L1 9/9 1.04 GB 0.0 1.7 1.0 0.6 1.7 1.0 0.1 1.6 237.4 236.6 7.16 6.95 3 2.386 1725K 5308 0.0 0.0 L2 1/0 992.19 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 236.2 236.1 0.53 0.51 1 0.533 127K 47 0.0 0.0 L3 17/0 866.25 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 212.1 212.1 0.59 0.52 1 0.589 126K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1200/21 99.88 GB 0.0 4.3 1.2 3.1 8.0 5.0 0.4 2.1 156.9 293.3 28.10 26.43 68 0.413 4475K 7944 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 1.2 3.1 8.0 5.0 0.3 2.1 156.9 293.3 28.10 26.43 68 0.413 4475K 7944 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 1.2 3.1 4.3 1.2 0.0 0.0 252.7 252.3 17.44 16.94 14 1.246 4475K 7944 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 360.5 10.66 9.49 54 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.7 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.05 GB write, 687.91 MB/s write, 4.30 GB read, 367.87 MB/s read, 28.1 seconds Interval compaction: 8.05 GB write, 702.55 MB/s write, 4.30 GB read, 375.70 MB/s read, 28.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 927554 Average: 2.1719 StdDev: 15.47 Min: 1 Median: 1.4572 Max: 4145 Percentiles: P50: 1.46 P75: 1.83 P99: 5.48 P99.9: 10.10 P99.99: 16.48 ------------------------------------------------------ [ 0, 1 ] 177970 19.187% 19.187% #### ( 1, 2 ] 625066 67.389% 86.576% ############# ( 2, 3 ] 76640 8.263% 94.838% ## ( 3, 4 ] 25456 2.744% 97.583% # ( 4, 6 ] 17780 1.917% 99.500% ( 6, 10 ] 3697 0.399% 99.898% ( 10, 15 ] 832 0.090% 99.988% ( 15, 22 ] 96 0.010% 99.998% ( 22, 34 ] 10 0.001% 99.999% ( 34, 51 ] 10 0.001% 100.000% ( 51, 76 ] 7 0.001% 100.001% ( 76, 110 ] 3 0.000% 100.001% ( 110, 170 ] 79 0.009% 100.010% ( 170, 250 ] 18 0.002% 100.012% ( 250, 380 ] 15 0.002% 100.013% ( 380, 580 ] 18 0.002% 100.015% ( 580, 870 ] 24 0.003% 100.018% ( 870, 1300 ] 12 0.001% 100.019% ( 1300, 1900 ] 5 0.001% 100.020% ( 1900, 2900 ] 9 0.001% 100.021% ( 2900, 4400 ] 9 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 159987 Average: 2.3761 StdDev: 25.60 Min: 1 Median: 1.4957 Max: 8129 Percentiles: P50: 1.50 P75: 1.86 P99: 5.55 P99.9: 13.59 P99.99: 696.08 ------------------------------------------------------ [ 0, 1 ] 25839 16.151% 16.151% ### ( 1, 2 ] 109238 68.279% 84.430% ############## ( 2, 3 ] 15708 9.818% 94.248% ## ( 3, 4 ] 4788 2.993% 97.241% # ( 4, 6 ] 3625 2.266% 99.507% ( 6, 10 ] 514 0.321% 99.828% ( 10, 15 ] 160 0.100% 99.928% ( 15, 22 ] 11 0.007% 99.935% ( 22, 34 ] 3 0.002% 99.937% ( 34, 51 ] 1 0.001% 99.937% ( 51, 76 ] 2 0.001% 99.939% ( 110, 170 ] 59 0.037% 99.976% ( 170, 250 ] 6 0.004% 99.979% ( 250, 380 ] 10 0.006% 99.986% ( 380, 580 ] 5 0.003% 99.989% ( 580, 870 ] 5 0.003% 99.992% ( 870, 1300 ] 4 0.003% 99.994% ( 1300, 1900 ] 7 0.004% 99.999% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31737 Average: 2.3783 StdDev: 5.65 Min: 1 Median: 1.5956 Max: 890 Percentiles: P50: 1.60 P75: 1.99 P99: 5.96 P99.9: 11.17 P99.99: 31.92 ------------------------------------------------------ [ 0, 1 ] 3933 12.392% 12.392% ## ( 1, 2 ] 20040 63.144% 75.536% ############# ( 2, 3 ] 4104 12.931% 88.468% ### ( 3, 4 ] 1839 5.794% 94.262% # ( 4, 6 ] 1532 4.827% 99.089% # ( 6, 10 ] 250 0.788% 99.877% ( 10, 15 ] 31 0.098% 99.975% ( 15, 22 ] 4 0.013% 99.987% ( 22, 34 ] 1 0.003% 99.991% ( 34, 51 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1758.5500 StdDev: 2870.14 Min: 1 Median: 380.0000 Max: 9217 Percentiles: P50: 380.00 P75: 1300.00 P99: 9217.00 P99.9: 9217.00 P99.99: 9217.00 ------------------------------------------------------ [ 0, 1 ] 4 5.000% 5.000% # ( 1, 2 ] 26 32.500% 37.500% ####### ( 2, 3 ] 2 2.500% 40.000% # ( 3, 4 ] 4 5.000% 45.000% # ( 4, 6 ] 1 1.250% 46.250% ( 6, 10 ] 1 1.250% 47.500% ( 250, 380 ] 2 2.500% 50.000% # ( 380, 580 ] 10 12.500% 62.500% ### ( 580, 870 ] 9 11.250% 73.750% ## ( 870, 1300 ] 1 1.250% 75.000% ( 1900, 2900 ] 3 3.750% 78.750% # ( 4400, 6600 ] 5 6.250% 85.000% # ( 6600, 9900 ] 12 15.000% 100.000% ### ** Level 4 read latency histogram (micros): Count: 35 Average: 4397.1429 StdDev: 3184.38 Min: 507 Median: 4557.1429 Max: 9994 Percentiles: P50: 4557.14 P75: 7342.50 P99: 9994.00 P99.9: 9994.00 P99.99: 9994.00 ------------------------------------------------------ ( 380, 580 ] 2 5.714% 5.714% # ( 580, 870 ] 7 20.000% 25.714% #### ( 870, 1300 ] 2 5.714% 31.429% # ( 1300, 1900 ] 2 5.714% 37.143% # ( 1900, 2900 ] 3 8.571% 45.714% ## ( 2900, 4400 ] 1 2.857% 48.571% # ( 4400, 6600 ] 7 20.000% 68.571% #### ( 6600, 9900 ] 10 28.571% 97.143% ###### ( 9900, 14000 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 328.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.357 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.366 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/15-08:53:52 ... thread 0: (1000000,5000000) ops and (289513.6,329297.9) ops/second in (3.454069,15.183820) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.50 GB 100.7 3.2 0.0 3.2 7.9 4.7 0.0 1.7 128.5 316.1 25.50 23.78 80 0.319 3326K 3430 0.0 0.0 L1 9/9 1.04 GB 0.0 1.7 1.0 0.6 1.7 1.0 0.1 1.6 237.4 236.6 7.16 6.95 3 2.386 1725K 5308 0.0 0.0 L2 1/0 992.19 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 236.2 236.1 0.53 0.51 1 0.533 127K 47 0.0 0.0 L3 17/0 866.25 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 212.1 212.1 0.59 0.52 1 0.589 126K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1205/21 100.80 GB 0.0 5.1 1.2 3.9 9.8 5.9 0.4 2.1 154.7 296.2 33.78 31.76 85 0.397 5306K 8785 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 1.2 3.9 9.8 5.9 0.3 2.1 154.7 296.2 33.78 31.76 85 0.397 5306K 8785 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 1.2 3.9 5.1 1.2 0.0 0.0 255.0 254.5 20.50 19.95 17 1.206 5306K 8785 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 360.6 13.28 11.81 68 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.2 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.77 GB write, 648.20 MB/s write, 5.10 GB read, 338.61 MB/s read, 33.8 seconds Interval compaction: 9.77 GB write, 658.85 MB/s write, 5.10 GB read, 344.18 MB/s read, 33.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 17, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1279768 Average: 2.1956 StdDev: 14.24 Min: 1 Median: 1.4772 Max: 4145 Percentiles: P50: 1.48 P75: 1.84 P99: 5.50 P99.9: 9.93 P99.99: 15.61 ------------------------------------------------------ [ 0, 1 ] 224033 17.506% 17.506% #### ( 1, 2 ] 871436 68.093% 85.599% ############## ( 2, 3 ] 115256 9.006% 94.605% ## ( 3, 4 ] 36821 2.877% 97.482% # ( 4, 6 ] 25814 2.017% 99.499% ( 6, 10 ] 5213 0.407% 99.907% ( 10, 15 ] 1056 0.083% 99.989% ( 15, 22 ] 127 0.010% 99.999% ( 22, 34 ] 17 0.001% 100.000% ( 34, 51 ] 15 0.001% 100.002% ( 51, 76 ] 8 0.001% 100.002% ( 76, 110 ] 8 0.001% 100.003% ( 110, 170 ] 119 0.009% 100.012% ( 170, 250 ] 31 0.002% 100.015% ( 250, 380 ] 25 0.002% 100.016% ( 380, 580 ] 29 0.002% 100.019% ( 580, 870 ] 34 0.003% 100.021% ( 870, 1300 ] 16 0.001% 100.023% ( 1300, 1900 ] 8 0.001% 100.023% ( 1900, 2900 ] 10 0.001% 100.024% ( 2900, 4400 ] 10 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 219778 Average: 2.3935 StdDev: 22.38 Min: 1 Median: 1.5032 Max: 8129 Percentiles: P50: 1.50 P75: 1.87 P99: 5.90 P99.9: 14.34 P99.99: 609.64 ------------------------------------------------------ [ 0, 1 ] 34271 15.593% 15.593% ### ( 1, 2 ] 150284 68.380% 83.973% ############## ( 2, 3 ] 21775 9.908% 93.881% ## ( 3, 4 ] 6544 2.978% 96.859% # ( 4, 6 ] 4956 2.255% 99.114% ( 6, 10 ] 1506 0.685% 99.799% ( 10, 15 ] 256 0.116% 99.915% ( 15, 22 ] 17 0.008% 99.923% ( 22, 34 ] 3 0.001% 99.924% ( 34, 51 ] 1 0.000% 99.925% ( 51, 76 ] 2 0.001% 99.926% ( 76, 110 ] 27 0.012% 99.938% ( 110, 170 ] 75 0.034% 99.972% ( 170, 250 ] 14 0.006% 99.979% ( 250, 380 ] 13 0.006% 99.985% ( 380, 580 ] 11 0.005% 99.990% ( 580, 870 ] 10 0.005% 99.994% ( 870, 1300 ] 4 0.002% 99.996% ( 1300, 1900 ] 7 0.003% 99.999% ( 2900, 4400 ] 1 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 31737 Average: 2.3783 StdDev: 5.65 Min: 1 Median: 1.5956 Max: 890 Percentiles: P50: 1.60 P75: 1.99 P99: 5.96 P99.9: 11.17 P99.99: 31.92 ------------------------------------------------------ [ 0, 1 ] 3933 12.392% 12.392% ## ( 1, 2 ] 20040 63.144% 75.536% ############# ( 2, 3 ] 4104 12.931% 88.468% ### ( 3, 4 ] 1839 5.794% 94.262% # ( 4, 6 ] 1532 4.827% 99.089% # ( 6, 10 ] 250 0.788% 99.877% ( 10, 15 ] 31 0.098% 99.975% ( 15, 22 ] 4 0.013% 99.987% ( 22, 34 ] 1 0.003% 99.991% ( 34, 51 ] 1 0.003% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1758.5500 StdDev: 2870.14 Min: 1 Median: 380.0000 Max: 9217 Percentiles: P50: 380.00 P75: 1300.00 P99: 9217.00 P99.9: 9217.00 P99.99: 9217.00 ------------------------------------------------------ [ 0, 1 ] 4 5.000% 5.000% # ( 1, 2 ] 26 32.500% 37.500% ####### ( 2, 3 ] 2 2.500% 40.000% # ( 3, 4 ] 4 5.000% 45.000% # ( 4, 6 ] 1 1.250% 46.250% ( 6, 10 ] 1 1.250% 47.500% ( 250, 380 ] 2 2.500% 50.000% # ( 380, 580 ] 10 12.500% 62.500% ### ( 580, 870 ] 9 11.250% 73.750% ## ( 870, 1300 ] 1 1.250% 75.000% ( 1900, 2900 ] 3 3.750% 78.750% # ( 4400, 6600 ] 5 6.250% 85.000% # ( 6600, 9900 ] 12 15.000% 100.000% ### ** Level 4 read latency histogram (micros): Count: 35 Average: 4397.1429 StdDev: 3184.38 Min: 507 Median: 4557.1429 Max: 9994 Percentiles: P50: 4557.14 P75: 7342.50 P99: 9994.00 P99.9: 9994.00 P99.99: 9994.00 ------------------------------------------------------ ( 380, 580 ] 2 5.714% 5.714% # ( 580, 870 ] 7 20.000% 25.714% #### ( 870, 1300 ] 2 5.714% 31.429% # ( 1300, 1900 ] 2 5.714% 37.143% # ( 1900, 2900 ] 3 8.571% 45.714% ## ( 2900, 4400 ] 1 2.857% 48.571% # ( 4400, 6600 ] 7 20.000% 68.571% #### ( 6600, 9900 ] 10 28.571% 97.143% ###### ( 9900, 14000 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 15.4 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 318.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.169 H:M:S, 14.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 284.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.812 H:M:S, 23.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/15-08:54:05 ... thread 0: (1000000,6000000) ops and (75993.0,211693.1) ops/second in (13.159100,28.342920) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/7 1.96 GB 0.0 5.0 0.0 5.0 10.6 5.7 0.0 1.9 145.3 310.2 35.10 32.95 101 0.348 5180K 6799 0.0 0.0 L1 13/13 1.49 GB 0.0 5.2 3.6 1.7 5.2 3.5 0.1 1.4 228.1 225.4 23.43 22.23 4 5.857 5427K 64K 0.0 0.0 L2 17/5 2.01 GB 15.5 0.1 0.1 0.1 0.1 0.1 2.2 2.0 236.2 236.1 0.53 0.51 1 0.533 127K 47 0.0 0.0 L3 17/10 866.25 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.1 1.0 212.1 212.1 0.59 0.52 1 0.589 126K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1214/35 101.73 GB 0.0 10.4 3.7 6.7 16.0 9.3 2.4 2.8 179.3 275.3 59.66 56.22 107 0.558 10M 71K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.4 3.7 6.7 16.0 9.3 2.3 2.8 179.3 275.3 59.66 56.22 107 0.558 10M 71K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.4 3.7 6.7 10.4 3.7 0.0 0.0 246.0 244.4 43.49 41.86 23 1.891 10M 71K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 358.5 16.17 14.36 84 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.6 total, 28.3 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.04 GB write, 574.32 MB/s write, 10.45 GB read, 374.14 MB/s read, 59.7 seconds Interval compaction: 16.04 GB write, 579.37 MB/s write, 10.45 GB read, 377.43 MB/s read, 59.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 17, interval: 36 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2258322 Average: 2.4588 StdDev: 15.52 Min: 1 Median: 1.4773 Max: 4145 Percentiles: P50: 1.48 P75: 1.84 P99: 5.84 P99.9: 115.43 P99.99: 265.01 ------------------------------------------------------ [ 0, 1 ] 390713 17.301% 17.301% ### ( 1, 2 ] 1547137 68.508% 85.809% ############## ( 2, 3 ] 195089 8.639% 94.448% ## ( 3, 4 ] 62818 2.782% 97.230% # ( 4, 6 ] 43568 1.929% 99.159% ( 6, 10 ] 13162 0.583% 99.742% ( 10, 15 ] 1884 0.083% 99.825% ( 15, 22 ] 343 0.015% 99.840% ( 22, 34 ] 32 0.001% 99.842% ( 34, 51 ] 20 0.001% 99.843% ( 51, 76 ] 14 0.001% 99.843% ( 76, 110 ] 1125 0.050% 99.893% ( 110, 170 ] 1775 0.079% 99.972% ( 170, 250 ] 387 0.017% 99.989% ( 250, 380 ] 270 0.012% 100.001% ( 380, 580 ] 250 0.011% 100.012% ( 580, 870 ] 125 0.006% 100.017% ( 870, 1300 ] 42 0.002% 100.019% ( 1300, 1900 ] 10 0.000% 100.020% ( 1900, 2900 ] 19 0.001% 100.020% ( 2900, 4400 ] 12 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 444445 Average: 2.6984 StdDev: 22.56 Min: 1 Median: 1.4843 Max: 8129 Percentiles: P50: 1.48 P75: 1.85 P99: 7.74 P99.9: 149.41 P99.99: 879.55 ------------------------------------------------------ [ 0, 1 ] 76609 17.237% 17.237% ### ( 1, 2 ] 300667 67.650% 84.887% ############## ( 2, 3 ] 39267 8.835% 93.722% ## ( 3, 4 ] 12327 2.774% 96.496% # ( 4, 6 ] 9064 2.039% 98.535% ( 6, 10 ] 4749 1.069% 99.604% ( 10, 15 ] 523 0.118% 99.721% ( 15, 22 ] 89 0.020% 99.741% ( 22, 34 ] 6 0.001% 99.743% ( 34, 51 ] 1 0.000% 99.743% ( 51, 76 ] 8 0.002% 99.745% ( 76, 110 ] 375 0.084% 99.829% ( 110, 170 ] 482 0.108% 99.937% ( 170, 250 ] 89 0.020% 99.957% ( 250, 380 ] 54 0.012% 99.970% ( 380, 580 ] 52 0.012% 99.981% ( 580, 870 ] 39 0.009% 99.990% ( 870, 1300 ] 25 0.006% 99.996% ( 1300, 1900 ] 12 0.003% 99.998% ( 1900, 2900 ] 4 0.001% 99.999% ( 2900, 4400 ] 3 0.001% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 31758 Average: 2.6296 StdDev: 12.48 Min: 1 Median: 1.5961 Max: 890 Percentiles: P50: 1.60 P75: 1.99 P99: 5.99 P99.9: 14.56 P99.99: 743.80 ------------------------------------------------------ [ 0, 1 ] 3933 12.384% 12.384% ## ( 1, 2 ] 20040 63.102% 75.486% ############# ( 2, 3 ] 4104 12.923% 88.409% ### ( 3, 4 ] 1839 5.791% 94.200% # ( 4, 6 ] 1532 4.824% 99.024% # ( 6, 10 ] 250 0.787% 99.811% ( 10, 15 ] 31 0.098% 99.909% ( 15, 22 ] 4 0.013% 99.921% ( 22, 34 ] 1 0.003% 99.924% ( 34, 51 ] 1 0.003% 99.928% ( 110, 170 ] 4 0.013% 99.940% ( 170, 250 ] 4 0.013% 99.953% ( 250, 380 ] 2 0.006% 99.959% ( 380, 580 ] 7 0.022% 99.981% ( 580, 870 ] 5 0.016% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 16914 Average: 14.1869 StdDev: 234.80 Min: 1 Median: 1.5376 Max: 9217 Percentiles: P50: 1.54 P75: 1.92 P99: 194.10 P99.9: 4877.84 P99.99: 9217.00 ------------------------------------------------------ [ 0, 1 ] 2459 14.538% 14.538% ### ( 1, 2 ] 11157 65.963% 80.501% ############# ( 2, 3 ] 1605 9.489% 89.991% ## ( 3, 4 ] 597 3.530% 93.520% # ( 4, 6 ] 498 2.944% 96.464% # ( 6, 10 ] 329 1.945% 98.410% ( 10, 15 ] 26 0.154% 98.563% ( 15, 22 ] 1 0.006% 98.569% ( 76, 110 ] 9 0.053% 98.622% ( 110, 170 ] 50 0.296% 98.918% ( 170, 250 ] 46 0.272% 99.190% ( 250, 380 ] 49 0.290% 99.480% ( 380, 580 ] 37 0.219% 99.698% ( 580, 870 ] 22 0.130% 99.829% ( 870, 1300 ] 7 0.041% 99.870% ( 1300, 1900 ] 1 0.006% 99.876% ( 1900, 2900 ] 3 0.018% 99.894% ( 4400, 6600 ] 5 0.030% 99.923% ( 6600, 9900 ] 12 0.071% 99.994% ** Level 4 read latency histogram (micros): Count: 35 Average: 4397.1429 StdDev: 3184.38 Min: 507 Median: 4557.1429 Max: 9994 Percentiles: P50: 4557.14 P75: 7342.50 P99: 9994.00 P99.9: 9994.00 P99.99: 9994.00 ------------------------------------------------------ ( 380, 580 ] 2 5.714% 5.714% # ( 580, 870 ] 7 20.000% 25.714% #### ( 870, 1300 ] 2 5.714% 31.429% # ( 1300, 1900 ] 2 5.714% 37.143% # ( 1900, 2900 ] 3 8.571% 45.714% ## ( 2900, 4400 ] 1 2.857% 48.571% # ( 4400, 6600 ] 7 20.000% 68.571% #### ( 6600, 9900 ] 10 28.571% 97.143% ###### ( 9900, 14000 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 28.6 total, 13.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 206.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.156 H:M:S, 42.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 74.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.987 H:M:S, 75.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/15-08:54:12 ... thread 0: (1000000,7000000) ops and (162087.7,202825.5) ops/second in (6.169501,34.512421) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 2.89 GB 37.8 5.5 0.0 5.5 12.1 6.6 0.0 1.8 138.9 303.8 40.82 37.63 117 0.349 5756K 7382 0.0 0.0 L1 13/13 1.49 GB 0.0 5.2 3.6 1.7 5.2 3.5 0.1 1.4 228.1 225.4 23.43 22.23 4 5.857 5427K 64K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.2 2.0 236.2 236.1 0.53 0.51 1 0.533 127K 47 0.0 0.0 L3 21/0 865.95 MB 0.9 3.2 2.1 1.0 3.2 2.1 0.1 1.5 187.4 187.2 17.33 14.12 15 1.155 3267K 2320 0.0 0.0 L4 158/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 1.8 1.0 209.0 209.0 0.82 0.76 3 0.273 173K 0 0.0 0.0 L5 1068/0 87.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1278/28 102.65 GB 0.0 14.2 5.9 8.3 20.7 12.4 6.2 3.1 175.5 255.9 82.93 75.24 140 0.592 14M 74K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.2 5.9 8.3 20.7 12.4 6.1 3.1 175.5 255.9 82.93 75.24 140 0.592 14M 74K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.2 5.9 8.3 14.1 5.9 0.0 0.0 229.9 228.7 63.32 58.42 42 1.508 14M 74K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 343.7 19.61 16.82 98 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.8 total, 34.5 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.73 GB write, 610.53 MB/s write, 14.22 GB read, 418.80 MB/s read, 82.9 seconds Interval compaction: 20.73 GB write, 614.94 MB/s write, 14.22 GB read, 421.83 MB/s read, 82.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 28, total-stops: 35, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2738678 Average: 2.5254 StdDev: 15.55 Min: 1 Median: 1.5173 Max: 4145 Percentiles: P50: 1.52 P75: 1.89 P99: 6.18 P99.9: 103.11 P99.99: 245.52 ------------------------------------------------------ [ 0, 1 ] 417662 15.250% 15.250% ### ( 1, 2 ] 1839718 67.175% 82.426% ############# ( 2, 3 ] 283146 10.339% 92.765% ## ( 3, 4 ] 93876 3.428% 96.192% # ( 4, 6 ] 75950 2.773% 98.966% # ( 6, 10 ] 20923 0.764% 99.730% ( 10, 15 ] 3203 0.117% 99.847% ( 15, 22 ] 479 0.017% 99.864% ( 22, 34 ] 41 0.001% 99.866% ( 34, 51 ] 23 0.001% 99.866% ( 51, 76 ] 15 0.001% 99.867% ( 76, 110 ] 1133 0.041% 99.908% ( 110, 170 ] 1816 0.066% 99.975% ( 170, 250 ] 444 0.016% 99.991% ( 250, 380 ] 304 0.011% 100.002% ( 380, 580 ] 301 0.011% 100.013% ( 580, 870 ] 149 0.005% 100.018% ( 870, 1300 ] 56 0.002% 100.020% ( 1300, 1900 ] 15 0.001% 100.021% ( 1900, 2900 ] 22 0.001% 100.022% ( 2900, 4400 ] 16 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 1013532 Average: 4.0804 StdDev: 47.40 Min: 1 Median: 1.6930 Max: 8129 Percentiles: P50: 1.69 P75: 2.40 P99: 9.19 P99.9: 150.19 P99.99: 369.32 ------------------------------------------------------ [ 0, 1 ] 89445 8.825% 8.825% ## ( 1, 2 ] 602169 59.413% 68.238% ############ ( 2, 3 ] 172819 17.051% 85.289% ### ( 3, 4 ] 60972 6.016% 91.305% # ( 4, 6 ] 63079 6.224% 97.529% # ( 6, 10 ] 18710 1.846% 99.375% ( 10, 15 ] 3742 0.369% 99.744% ( 15, 22 ] 502 0.050% 99.793% ( 22, 34 ] 56 0.006% 99.799% ( 34, 51 ] 6 0.001% 99.800% ( 51, 76 ] 9 0.001% 99.800% ( 76, 110 ] 479 0.047% 99.848% ( 110, 170 ] 792 0.078% 99.926% ( 170, 250 ] 345 0.034% 99.960% ( 250, 380 ] 333 0.033% 99.993% ( 380, 580 ] 349 0.034% 100.027% ( 580, 870 ] 317 0.031% 100.058% ( 870, 1300 ] 183 0.018% 100.076% ( 1300, 1900 ] 91 0.009% 100.085% ( 1900, 2900 ] 104 0.010% 100.096% ( 2900, 4400 ] 62 0.006% 100.102% ( 4400, 6600 ] 6 0.001% 100.102% ( 6600, 9900 ] 1 0.000% 100.103% ** Level 2 read latency histogram (micros): Count: 31983 Average: 3.0639 StdDev: 18.10 Min: 1 Median: 1.5996 Max: 905 Percentiles: P50: 1.60 P75: 2.00 P99: 6.59 P99.9: 310.81 P99.99: 820.36 ------------------------------------------------------ [ 0, 1 ] 3933 12.297% 12.297% ## ( 1, 2 ] 20111 62.880% 75.177% ############# ( 2, 3 ] 4191 13.104% 88.281% ### ( 3, 4 ] 1849 5.781% 94.062% # ( 4, 6 ] 1542 4.821% 98.884% # ( 6, 10 ] 254 0.794% 99.678% ( 10, 15 ] 31 0.097% 99.775% ( 15, 22 ] 4 0.013% 99.787% ( 22, 34 ] 1 0.003% 99.791% ( 34, 51 ] 1 0.003% 99.794% ( 110, 170 ] 7 0.022% 99.816% ( 170, 250 ] 20 0.063% 99.878% ( 250, 380 ] 15 0.047% 99.925% ( 380, 580 ] 15 0.047% 99.972% ( 580, 870 ] 7 0.022% 99.994% ( 870, 1300 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 285049 Average: 3.9170 StdDev: 60.68 Min: 1 Median: 1.7744 Max: 9217 Percentiles: P50: 1.77 P75: 2.58 P99: 8.99 P99.9: 179.90 P99.99: 454.67 ------------------------------------------------------ [ 0, 1 ] 15229 5.343% 5.343% # ( 1, 2 ] 164386 57.669% 63.012% ############ ( 2, 3 ] 58561 20.544% 83.556% #### ( 3, 4 ] 20085 7.046% 90.602% # ( 4, 6 ] 19982 7.010% 97.612% # ( 6, 10 ] 5300 1.859% 99.472% ( 10, 15 ] 781 0.274% 99.746% ( 15, 22 ] 75 0.026% 99.772% ( 22, 34 ] 17 0.006% 99.778% ( 34, 51 ] 4 0.001% 99.779% ( 51, 76 ] 6 0.002% 99.781% ( 76, 110 ] 105 0.037% 99.818% ( 110, 170 ] 216 0.076% 99.894% ( 170, 250 ] 137 0.048% 99.942% ( 250, 380 ] 107 0.038% 99.980% ( 380, 580 ] 79 0.028% 100.007% ( 580, 870 ] 49 0.017% 100.025% ( 870, 1300 ] 27 0.009% 100.034% ( 1300, 1900 ] 10 0.004% 100.038% ( 1900, 2900 ] 8 0.003% 100.040% ( 2900, 4400 ] 1 0.000% 100.041% ( 4400, 6600 ] 5 0.002% 100.042% ( 6600, 9900 ] 12 0.004% 100.047% ** Level 4 read latency histogram (micros): Count: 65 Average: 2401.4769 StdDev: 3180.99 Min: 1 Median: 600.7143 Max: 9994 Percentiles: P50: 600.71 P75: 4950.00 P99: 9994.00 P99.9: 9994.00 P99.99: 9994.00 ------------------------------------------------------ [ 0, 1 ] 7 10.769% 10.769% ## ( 1, 2 ] 9 13.846% 24.615% ### ( 2, 3 ] 2 3.077% 27.692% # ( 3, 4 ] 5 7.692% 35.385% ## ( 4, 6 ] 1 1.538% 36.923% ( 110, 170 ] 1 1.538% 38.462% ( 170, 250 ] 2 3.077% 41.538% # ( 380, 580 ] 5 7.692% 49.231% ## ( 580, 870 ] 7 10.769% 60.000% ## ( 870, 1300 ] 2 3.077% 63.077% # ( 1300, 1900 ] 2 3.077% 66.154% # ( 1900, 2900 ] 3 4.615% 70.769% # ( 2900, 4400 ] 1 1.538% 72.308% ( 4400, 6600 ] 7 10.769% 83.077% ## ( 6600, 9900 ] 10 15.385% 98.462% ### ( 9900, 14000 ] 1 1.538% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 1223.9083 StdDev: 1365.64 Min: 97 Median: 535.5556 Max: 4737 Percentiles: P50: 535.56 P75: 1900.00 P99: 4737.00 P99.9: 4737.00 P99.99: 4737.00 ------------------------------------------------------ ( 76, 110 ] 8 6.667% 6.667% # ( 110, 170 ] 18 15.000% 21.667% ### ( 170, 250 ] 12 10.000% 31.667% ## ( 250, 380 ] 15 12.500% 44.167% ### ( 380, 580 ] 9 7.500% 51.667% ## ( 580, 870 ] 6 5.000% 56.667% # ( 870, 1300 ] 12 10.000% 66.667% ## ( 1300, 1900 ] 10 8.333% 75.000% ## ( 1900, 2900 ] 14 11.667% 86.667% ## ( 2900, 4400 ] 9 7.500% 94.167% ## ( 4400, 6600 ] 7 5.833% 100.000% # ** DB Stats ** Uptime(secs): 34.8 total, 6.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 198.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.529 H:M:S, 44.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 159.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.373 H:M:S, 54.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/15-08:54:15 ... thread 0: (1000000,8000000) ops and (296552.3,211168.1) ops/second in (3.372086,37.884507) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 20/11 3.93 GB 176.2 6.3 0.0 6.3 14.0 7.6 0.0 1.8 138.2 304.4 46.95 43.36 134 0.350 6587K 8274 0.0 0.0 L1 13/13 1.49 GB 0.0 5.2 3.6 1.7 5.2 3.5 0.1 1.4 228.1 225.4 23.43 22.23 4 5.857 5427K 64K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.2 2.0 236.2 236.1 0.53 0.51 1 0.533 127K 47 0.0 0.0 L3 21/0 865.95 MB 0.9 3.2 2.1 1.0 3.2 2.1 0.1 1.5 187.4 187.2 17.33 14.12 15 1.155 3267K 2320 0.0 0.0 L4 158/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 1.8 1.0 209.0 209.0 0.82 0.76 3 0.273 173K 0 0.0 0.0 L5 1068/0 87.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1280/24 103.69 GB 0.0 15.0 5.9 9.1 22.6 13.5 6.2 3.0 172.7 259.5 89.07 80.98 157 0.567 15M 75K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.0 5.9 9.1 22.6 13.5 6.1 3.0 172.7 259.5 89.07 80.98 157 0.567 15M 75K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.0 5.9 9.1 14.9 5.9 0.0 0.0 231.4 230.2 66.46 61.49 45 1.477 15M 75K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 345.5 22.61 19.48 112 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.1 total, 37.9 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.57 GB write, 606.07 MB/s write, 15.02 GB read, 403.24 MB/s read, 89.1 seconds Interval compaction: 22.57 GB write, 610.06 MB/s write, 15.02 GB read, 405.90 MB/s read, 89.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 39, interval: 68 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3049506 Average: 2.5202 StdDev: 15.20 Min: 0 Median: 1.5207 Max: 4145 Percentiles: P50: 1.52 P75: 1.89 P99: 6.08 P99.9: 100.18 P99.99: 248.86 ------------------------------------------------------ [ 0, 1 ] 454453 14.903% 14.903% ### ( 1, 2 ] 2055556 67.406% 82.309% ############# ( 2, 3 ] 320393 10.506% 92.815% ## ( 3, 4 ] 104165 3.416% 96.231% # ( 4, 6 ] 84002 2.755% 98.986% # ( 6, 10 ] 22895 0.751% 99.736% ( 10, 15 ] 3565 0.117% 99.853% ( 15, 22 ] 499 0.016% 99.870% ( 22, 34 ] 44 0.001% 99.871% ( 34, 51 ] 23 0.001% 99.872% ( 51, 76 ] 17 0.001% 99.872% ( 76, 110 ] 1189 0.039% 99.911% ( 110, 170 ] 1922 0.063% 99.974% ( 170, 250 ] 486 0.016% 99.990% ( 250, 380 ] 347 0.011% 100.002% ( 380, 580 ] 337 0.011% 100.013% ( 580, 870 ] 166 0.005% 100.018% ( 870, 1300 ] 68 0.002% 100.020% ( 1300, 1900 ] 18 0.001% 100.021% ( 1900, 2900 ] 22 0.001% 100.022% ( 2900, 4400 ] 16 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 1135823 Average: 3.9225 StdDev: 44.89 Min: 1 Median: 1.6791 Max: 8129 Percentiles: P50: 1.68 P75: 2.34 P99: 9.10 P99.9: 148.37 P99.99: 373.47 ------------------------------------------------------ [ 0, 1 ] 101088 8.900% 8.900% ## ( 1, 2 ] 687449 60.524% 69.424% ############ ( 2, 3 ] 188720 16.615% 86.040% ### ( 3, 4 ] 64712 5.697% 91.737% # ( 4, 6 ] 66387 5.845% 97.582% # ( 6, 10 ] 20803 1.832% 99.413% ( 10, 15 ] 3872 0.341% 99.754% ( 15, 22 ] 505 0.044% 99.799% ( 22, 34 ] 58 0.005% 99.804% ( 34, 51 ] 7 0.001% 99.804% ( 51, 76 ] 9 0.001% 99.805% ( 76, 110 ] 517 0.046% 99.851% ( 110, 170 ] 879 0.077% 99.928% ( 170, 250 ] 373 0.033% 99.961% ( 250, 380 ] 350 0.031% 99.992% ( 380, 580 ] 364 0.032% 100.024% ( 580, 870 ] 324 0.029% 100.052% ( 870, 1300 ] 183 0.016% 100.068% ( 1300, 1900 ] 91 0.008% 100.076% ( 1900, 2900 ] 104 0.009% 100.086% ( 2900, 4400 ] 62 0.005% 100.091% ( 4400, 6600 ] 6 0.001% 100.092% ( 6600, 9900 ] 1 0.000% 100.092% ** Level 2 read latency histogram (micros): Count: 31983 Average: 3.0639 StdDev: 18.10 Min: 1 Median: 1.5996 Max: 905 Percentiles: P50: 1.60 P75: 2.00 P99: 6.59 P99.9: 310.81 P99.99: 820.36 ------------------------------------------------------ [ 0, 1 ] 3933 12.297% 12.297% ## ( 1, 2 ] 20111 62.880% 75.177% ############# ( 2, 3 ] 4191 13.104% 88.281% ### ( 3, 4 ] 1849 5.781% 94.062% # ( 4, 6 ] 1542 4.821% 98.884% # ( 6, 10 ] 254 0.794% 99.678% ( 10, 15 ] 31 0.097% 99.775% ( 15, 22 ] 4 0.013% 99.787% ( 22, 34 ] 1 0.003% 99.791% ( 34, 51 ] 1 0.003% 99.794% ( 110, 170 ] 7 0.022% 99.816% ( 170, 250 ] 20 0.063% 99.878% ( 250, 380 ] 15 0.047% 99.925% ( 380, 580 ] 15 0.047% 99.972% ( 580, 870 ] 7 0.022% 99.994% ( 870, 1300 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 285049 Average: 3.9170 StdDev: 60.68 Min: 1 Median: 1.7744 Max: 9217 Percentiles: P50: 1.77 P75: 2.58 P99: 8.99 P99.9: 179.90 P99.99: 454.67 ------------------------------------------------------ [ 0, 1 ] 15229 5.343% 5.343% # ( 1, 2 ] 164386 57.669% 63.012% ############ ( 2, 3 ] 58561 20.544% 83.556% #### ( 3, 4 ] 20085 7.046% 90.602% # ( 4, 6 ] 19982 7.010% 97.612% # ( 6, 10 ] 5300 1.859% 99.472% ( 10, 15 ] 781 0.274% 99.746% ( 15, 22 ] 75 0.026% 99.772% ( 22, 34 ] 17 0.006% 99.778% ( 34, 51 ] 4 0.001% 99.779% ( 51, 76 ] 6 0.002% 99.781% ( 76, 110 ] 105 0.037% 99.818% ( 110, 170 ] 216 0.076% 99.894% ( 170, 250 ] 137 0.048% 99.942% ( 250, 380 ] 107 0.038% 99.980% ( 380, 580 ] 79 0.028% 100.007% ( 580, 870 ] 49 0.017% 100.025% ( 870, 1300 ] 27 0.009% 100.034% ( 1300, 1900 ] 10 0.004% 100.038% ( 1900, 2900 ] 8 0.003% 100.040% ( 2900, 4400 ] 1 0.000% 100.041% ( 4400, 6600 ] 5 0.002% 100.042% ( 6600, 9900 ] 12 0.004% 100.047% ** Level 4 read latency histogram (micros): Count: 65 Average: 2401.4769 StdDev: 3180.99 Min: 1 Median: 600.7143 Max: 9994 Percentiles: P50: 600.71 P75: 4950.00 P99: 9994.00 P99.9: 9994.00 P99.99: 9994.00 ------------------------------------------------------ [ 0, 1 ] 7 10.769% 10.769% ## ( 1, 2 ] 9 13.846% 24.615% ### ( 2, 3 ] 2 3.077% 27.692% # ( 3, 4 ] 5 7.692% 35.385% ## ( 4, 6 ] 1 1.538% 36.923% ( 110, 170 ] 1 1.538% 38.462% ( 170, 250 ] 2 3.077% 41.538% # ( 380, 580 ] 5 7.692% 49.231% ## ( 580, 870 ] 7 10.769% 60.000% ## ( 870, 1300 ] 2 3.077% 63.077% # ( 1300, 1900 ] 2 3.077% 66.154% # ( 1900, 2900 ] 3 4.615% 70.769% # ( 2900, 4400 ] 1 1.538% 72.308% ( 4400, 6600 ] 7 10.769% 83.077% ## ( 6600, 9900 ] 10 15.385% 98.462% ### ( 9900, 14000 ] 1 1.538% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 1223.9083 StdDev: 1365.64 Min: 97 Median: 535.5556 Max: 4737 Percentiles: P50: 535.56 P75: 1900.00 P99: 4737.00 P99.9: 4737.00 P99.99: 4737.00 ------------------------------------------------------ ( 76, 110 ] 8 6.667% 6.667% # ( 110, 170 ] 18 15.000% 21.667% ### ( 170, 250 ] 12 10.000% 31.667% ## ( 250, 380 ] 15 12.500% 44.167% ### ( 380, 580 ] 9 7.500% 51.667% ## ( 580, 870 ] 6 5.000% 56.667% # ( 870, 1300 ] 12 10.000% 66.667% ## ( 1300, 1900 ] 10 8.333% 75.000% ## ( 1900, 2900 ] 14 11.667% 86.667% ## ( 2900, 4400 ] 9 7.500% 94.167% ## ( 4400, 6600 ] 7 5.833% 100.000% # ** DB Stats ** Uptime(secs): 38.1 total, 3.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 206.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.292 H:M:S, 42.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 291.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.764 H:M:S, 22.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.895 micros/op 145031 ops/sec 60.056 seconds 8709999 operations; 140.5 MB/s Microseconds per write: Count: 8709999 Average: 6.8951 StdDev: 321.74 Min: 1 Median: 1.7413 Max: 646534 Percentiles: P50: 1.74 P75: 2.74 P99: 10.91 P99.9: 1222.14 P99.99: 2724.32 ------------------------------------------------------ [ 0, 1 ] 1147145 13.170% 13.170% ### ( 1, 2 ] 4327108 49.680% 62.850% ########## ( 2, 3 ] 1439050 16.522% 79.372% ### ( 3, 4 ] 1142544 13.118% 92.490% ### ( 4, 6 ] 414120 4.755% 97.244% # ( 6, 10 ] 143997 1.653% 98.897% ( 10, 15 ] 49321 0.566% 99.464% ( 15, 22 ] 9895 0.114% 99.577% ( 22, 34 ] 1577 0.018% 99.595% ( 34, 51 ] 205 0.002% 99.598% ( 51, 76 ] 18 0.000% 99.598% ( 76, 110 ] 6657 0.076% 99.674% ( 110, 170 ] 1765 0.020% 99.695% ( 170, 250 ] 212 0.002% 99.697% ( 250, 380 ] 197 0.002% 99.699% ( 380, 580 ] 22 0.000% 99.700% ( 580, 870 ] 15 0.000% 99.700% ( 870, 1300 ] 21297 0.245% 99.944% ( 1300, 1900 ] 37 0.000% 99.945% ( 1900, 2900 ] 4787 0.055% 100.000% ( 2900, 4400 ] 10 0.000% 100.000% ( 4400, 6600 ] 1 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 10 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 195590 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 8709999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 8988718968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 418 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35804149 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 25382699868 rocksdb.compact.write.bytes COUNT : 25198644085 rocksdb.flush.write.bytes COUNT : 8983974172 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 43 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 232 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 8911373312 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3316736 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 25461855354 rocksdb.non.last.level.read.count COUNT : 6153373 rocksdb.block.checksum.compute.count COUNT : 6152580 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.387309 P95 : 3.952919 P99 : 9.227810 P100 : 646532.000000 COUNT : 8709999 SUM : 55836719 rocksdb.compaction.times.micros P50 : 981428.571429 P95 : 4960000.000000 P99 : 16269264.000000 P100 : 16269264.000000 COUNT : 54 SUM : 88862396 rocksdb.compaction.times.cpu_micros P50 : 930833.333333 P95 : 4960000.000000 P99 : 15287719.000000 P100 : 15287719.000000 COUNT : 54 SUM : 82623479 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 700.519481 P95 : 1160.250000 P99 : 1293.550000 P100 : 1883.000000 COUNT : 124 SUM : 86568 rocksdb.compaction.outfile.sync.micros P50 : 819.717742 P95 : 6847.500000 P99 : 70187.500000 P100 : 108472.000000 COUNT : 277 SUM : 833190 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 100.083333 P95 : 341.684211 P99 : 852.600000 P100 : 2900.000000 COUNT : 212 SUM : 32003 rocksdb.table.open.io.micros P50 : 1488.571429 P95 : 9982.000000 P99 : 25032.000000 P100 : 25032.000000 COUNT : 418 SUM : 1057397 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.544727 P95 : 6.690503 P99 : 10.334534 P100 : 5714.000000 COUNT : 6151530 SUM : 29990435 rocksdb.read.block.get.micros P50 : 524.537815 P95 : 4160.000000 P99 : 8743.428571 P100 : 10125.000000 COUNT : 836 SUM : 856365 rocksdb.write.raw.block.micros P50 : 0.511226 P95 : 0.971329 P99 : 2.690492 P100 : 19630.000000 COUNT : 8279148 SUM : 15206760 rocksdb.numfiles.in.singlecompaction P50 : 3.341667 P95 : 7.900000 P99 : 21.965000 P100 : 35.000000 COUNT : 101 SUM : 420 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.566970 P95 : 1172.685187 P99 : 2438.600126 P100 : 646341.000000 COUNT : 222503 SUM : 35828961 rocksdb.sst.read.micros P50 : 1.529464 P95 : 3.926494 P99 : 7.973412 P100 : 9994.000000 COUNT : 6153675 SUM : 18132542 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 8709999 SUM : 8988718968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 206279.069767 P95 : 331714.285714 P99 : 377771.428571 P100 : 809764.000000 COUNT : 124 SUM : 24763933 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 255 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0