[2024-07-13 09:00:26.866801] Starting SPDK v24.09-pre git sha1 719d03c6a / DPDK 23.11.0 initialization... [2024-07-13 09:00:26.867074] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1412713 ] Set seed to 1720854026860352 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-13 09:00:26.994322] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-13 09:00:27.035686] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-13 09:00:27.035736] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1412713' to capture a snapshot of events at runtime. [2024-07-13 09:00:27.035746] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-13 09:00:27.035757] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-13 09:00:27.035767] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1412713 for offline analysis/debug. [2024-07-13 09:00:27.035851] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Jul 13 09:00:31 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/13-09:00:38 ... thread 0: (1000000,1000000) ops and (138343.4,138343.4) ops/second in (7.228389,7.228389) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.88 GB 44.0 0.4 0.0 0.4 1.2 0.8 0.0 1.5 39.7 125.7 9.52 3.87 10 0.952 383K 504 0.0 0.0 L1 7/7 852.56 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 2/1 142.58 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 26/7 1.35 GB 0.8 1.5 0.8 0.7 1.5 0.8 0.0 1.9 95.9 94.9 16.13 7.10 9 1.792 853K 0 0.0 0.0 L4 168/9 10.04 GB 1.0 3.8 2.7 1.1 3.8 2.7 0.0 1.4 107.1 106.4 36.67 18.12 27 1.358 1173K 0 0.0 0.0 L5 1112/0 91.41 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1323/30 105.65 GB 0.0 5.7 3.5 2.2 6.5 4.2 2.4 8.1 93.9 106.4 62.32 29.09 46 1.355 2410K 504 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 3.5 2.2 6.5 4.2 2.4 8.1 93.9 106.4 62.32 29.09 46 1.355 2410K 504 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 3.5 2.2 5.7 3.4 0.0 0.0 105.1 104.4 55.65 26.70 37 1.504 2410K 504 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 122.8 6.67 2.39 9 0.741 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.4 total, 7.2 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.47 GB write, 895.19 MB/s write, 5.71 GB read, 790.16 MB/s read, 62.3 seconds Interval compaction: 6.47 GB write, 916.67 MB/s write, 5.71 GB read, 809.12 MB/s read, 62.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 44, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 314802 Average: 12.0439 StdDev: 145.71 Min: 1 Median: 2.0432 Max: 6994 Percentiles: P50: 2.04 P75: 3.14 P99: 12.87 P99.9: 2219.27 P99.99: 3922.17 ------------------------------------------------------ [ 0, 1 ] 8757 2.782% 2.782% # ( 1, 2 ] 145281 46.150% 48.932% ######### ( 2, 3 ] 77788 24.710% 73.642% ##### ( 3, 4 ] 31372 9.966% 83.607% ## ( 4, 6 ] 36766 11.679% 95.287% ## ( 6, 10 ] 10501 3.336% 98.622% # ( 10, 15 ] 2071 0.658% 99.280% ( 15, 22 ] 291 0.092% 99.373% ( 22, 34 ] 26 0.008% 99.381% ( 34, 51 ] 14 0.004% 99.385% ( 51, 76 ] 12 0.004% 99.389% ( 76, 110 ] 5 0.002% 99.391% ( 110, 170 ] 16 0.005% 99.396% ( 170, 250 ] 59 0.019% 99.415% ( 250, 380 ] 144 0.046% 99.460% ( 380, 580 ] 259 0.082% 99.543% ( 580, 870 ] 398 0.126% 99.669% ( 870, 1300 ] 387 0.123% 99.792% ( 1300, 1900 ] 270 0.086% 99.878% ( 1900, 2900 ] 223 0.071% 99.949% ( 2900, 4400 ] 193 0.061% 100.010% ( 4400, 6600 ] 56 0.018% 100.028% ( 6600, 9900 ] 3 0.001% 100.029% ** Level 1 read latency histogram (micros): Count: 22627 Average: 20.9283 StdDev: 217.61 Min: 1 Median: 1.9521 Max: 8381 Percentiles: P50: 1.95 P75: 3.09 P99: 470.94 P99.9: 3587.39 P99.99: 8033.27 ------------------------------------------------------ [ 0, 1 ] 476 2.104% 2.104% ( 1, 2 ] 11383 50.307% 52.411% ########## ( 2, 3 ] 4909 21.695% 74.106% #### ( 3, 4 ] 2299 10.160% 84.267% ## ( 4, 6 ] 2497 11.035% 95.302% ## ( 6, 10 ] 663 2.930% 98.232% # ( 10, 15 ] 139 0.614% 98.847% ( 15, 22 ] 11 0.049% 98.895% ( 22, 34 ] 1 0.004% 98.900% ( 51, 76 ] 2 0.009% 98.908% ( 110, 170 ] 1 0.004% 98.913% ( 170, 250 ] 2 0.009% 98.922% ( 250, 380 ] 10 0.044% 98.966% ( 380, 580 ] 17 0.075% 99.041% ( 580, 870 ] 44 0.194% 99.235% ( 870, 1300 ] 61 0.270% 99.505% ( 1300, 1900 ] 43 0.190% 99.695% ( 1900, 2900 ] 34 0.150% 99.845% ( 2900, 4400 ] 27 0.119% 99.965% ( 4400, 6600 ] 4 0.018% 99.982% ( 6600, 9900 ] 4 0.018% 100.000% ** Level 2 read latency histogram (micros): Count: 130935 Average: 9.4017 StdDev: 130.29 Min: 1 Median: 1.9773 Max: 9392 Percentiles: P50: 1.98 P75: 3.03 P99: 11.38 P99.9: 1576.81 P99.99: 3635.87 ------------------------------------------------------ [ 0, 1 ] 3686 2.815% 2.815% # ( 1, 2 ] 63218 48.282% 51.097% ########## ( 2, 3 ] 30900 23.599% 74.697% ##### ( 3, 4 ] 13127 10.026% 84.722% ## ( 4, 6 ] 14215 10.857% 95.579% ## ( 6, 10 ] 4257 3.251% 98.830% # ( 10, 15 ] 806 0.616% 99.446% ( 15, 22 ] 100 0.076% 99.522% ( 22, 34 ] 23 0.018% 99.539% ( 34, 51 ] 13 0.010% 99.549% ( 51, 76 ] 8 0.006% 99.556% ( 76, 110 ] 1 0.001% 99.556% ( 110, 170 ] 16 0.012% 99.568% ( 170, 250 ] 27 0.021% 99.589% ( 250, 380 ] 69 0.053% 99.642% ( 380, 580 ] 87 0.066% 99.708% ( 580, 870 ] 122 0.093% 99.801% ( 870, 1300 ] 100 0.076% 99.878% ( 1300, 1900 ] 63 0.048% 99.926% ( 1900, 2900 ] 53 0.040% 99.966% ( 2900, 4400 ] 63 0.048% 100.015% ( 4400, 6600 ] 15 0.011% 100.026% ( 6600, 9900 ] 5 0.004% 100.030% ** Level 3 read latency histogram (micros): Count: 818454 Average: 11.5989 StdDev: 143.09 Min: 1 Median: 2.0413 Max: 11106 Percentiles: P50: 2.04 P75: 3.12 P99: 11.13 P99.9: 1024.90 P99.99: 1374.61 ------------------------------------------------------ [ 0, 1 ] 14631 1.788% 1.788% ( 1, 2 ] 386262 47.194% 48.982% ######### ( 2, 3 ] 201870 24.665% 73.647% ##### ( 3, 4 ] 89424 10.926% 84.572% ## ( 4, 6 ] 91383 11.165% 95.738% ## ( 6, 10 ] 25458 3.110% 98.848% # ( 10, 15 ] 5469 0.668% 99.517% ( 15, 22 ] 612 0.075% 99.591% ( 22, 34 ] 59 0.007% 99.599% ( 34, 51 ] 34 0.004% 99.603% ( 51, 76 ] 50 0.006% 99.609% ( 76, 110 ] 32 0.004% 99.613% ( 110, 170 ] 62 0.008% 99.620% ( 170, 250 ] 118 0.014% 99.635% ( 250, 380 ] 277 0.034% 99.669% ( 380, 580 ] 648 0.079% 99.748% ( 580, 870 ] 882 0.108% 99.855% ( 870, 1300 ] 1012 0.124% 99.979% ( 1300, 1900 ] 717 0.088% 100.067% ( 1900, 2900 ] 556 0.068% 100.135% ( 2900, 4400 ] 494 0.060% 100.195% ( 4400, 6600 ] 105 0.013% 100.208% ( 6600, 9900 ] 21 0.003% 100.210% ( 9900, 14000 ] 1 0.000% 100.211% ** Level 4 read latency histogram (micros): Count: 387893 Average: 22.9385 StdDev: 217.97 Min: 1 Median: 2.0327 Max: 10280 Percentiles: P50: 2.03 P75: 3.15 P99: 586.56 P99.9: 2732.19 P99.99: 3622.30 ------------------------------------------------------ [ 0, 1 ] 6726 1.734% 1.734% ( 1, 2 ] 184151 47.475% 49.209% ######### ( 2, 3 ] 93991 24.231% 73.440% ##### ( 3, 4 ] 41464 10.690% 84.129% ## ( 4, 6 ] 42373 10.924% 95.053% ## ( 6, 10 ] 11485 2.961% 98.014% # ( 10, 15 ] 2323 0.599% 98.613% ( 15, 22 ] 260 0.067% 98.680% ( 22, 34 ] 18 0.005% 98.685% ( 34, 51 ] 23 0.006% 98.691% ( 51, 76 ] 30 0.008% 98.698% ( 76, 110 ] 17 0.004% 98.703% ( 110, 170 ] 68 0.018% 98.720% ( 170, 250 ] 163 0.042% 98.762% ( 250, 380 ] 268 0.069% 98.831% ( 380, 580 ] 630 0.162% 98.994% ( 580, 870 ] 1109 0.286% 99.280% ( 870, 1300 ] 1083 0.279% 99.559% ( 1300, 1900 ] 794 0.205% 99.764% ( 1900, 2900 ] 637 0.164% 99.928% ( 2900, 4400 ] 503 0.130% 100.057% ( 4400, 6600 ] 137 0.035% 100.093% ( 6600, 9900 ] 15 0.004% 100.097% ( 9900, 14000 ] 1 0.000% 100.097% ** Level 5 read latency histogram (micros): Count: 13121 Average: 1581.3574 StdDev: 1355.25 Min: 77 Median: 1102.7597 Max: 15561 Percentiles: P50: 1102.76 P75: 2166.89 P99: 6431.77 P99.9: 9478.17 P99.99: 12720.39 ------------------------------------------------------ ( 76, 110 ] 10 0.076% 0.076% ( 110, 170 ] 86 0.655% 0.732% ( 170, 250 ] 256 1.951% 2.683% ( 250, 380 ] 764 5.823% 8.505% # ( 380, 580 ] 1585 12.080% 20.585% ## ( 580, 870 ] 2562 19.526% 40.111% #### ( 870, 1300 ] 2397 18.268% 58.380% #### ( 1300, 1900 ] 1766 13.459% 71.839% ### ( 1900, 2900 ] 1554 11.844% 83.683% ## ( 2900, 4400 ] 1500 11.432% 95.115% ## ( 4400, 6600 ] 552 4.207% 99.322% # ( 6600, 9900 ] 87 0.663% 99.985% ( 9900, 14000 ] 1 0.008% 99.992% ( 14000, 22000 ] 1 0.008% 100.000% ** DB Stats ** Uptime(secs): 7.4 total, 7.2 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 132.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.279 H:M:S, 44.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 136.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.279 H:M:S, 45.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/13-09:00:42 ... thread 0: (1000000,2000000) ops and (259976.7,180588.8) ops/second in (3.846498,11.074887) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/6 2.92 GB 163.6 1.5 0.0 1.5 3.4 1.8 0.0 1.8 87.8 193.0 17.95 11.43 30 0.598 1599K 1868 0.0 0.0 L1 7/7 852.56 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 53.83 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/0 989.24 MB 1.0 1.6 0.9 0.8 1.6 0.8 0.0 1.9 98.7 97.7 17.10 7.78 10 1.710 944K 0 0.0 0.0 L4 163/0 9.50 GB 1.0 4.7 3.2 1.6 4.7 3.1 0.0 1.5 112.1 111.1 43.29 22.24 31 1.396 1658K 0 0.0 0.0 L5 1124/0 92.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1328/13 106.67 GB 0.0 7.9 4.0 3.9 9.7 5.8 3.3 5.3 103.6 126.9 78.33 41.45 71 1.103 4201K 1868 0.0 0.0 Int 0/0 0.00 KB 0.0 7.9 4.0 3.9 9.7 5.8 3.3 5.3 103.6 126.9 78.33 41.45 71 1.103 4201K 1868 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.9 4.0 3.9 7.9 4.0 0.0 0.0 119.3 118.4 68.05 36.08 46 1.479 4201K 1868 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 183.8 10.28 5.37 25 0.411 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.3 total, 11.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.71 GB write, 883.89 MB/s write, 7.93 GB read, 721.35 MB/s read, 78.3 seconds Interval compaction: 9.71 GB write, 897.73 MB/s write, 7.93 GB read, 732.65 MB/s read, 78.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 49, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 689347 Average: 9.2797 StdDev: 104.15 Min: 0 Median: 1.7561 Max: 6994 Percentiles: P50: 1.76 P75: 2.62 P99: 136.73 P99.9: 1092.19 P99.99: 2374.85 ------------------------------------------------------ [ 0, 1 ] 68128 9.883% 9.883% ## ( 1, 2 ] 365766 53.060% 62.943% ########### ( 2, 3 ] 133676 19.392% 82.334% #### ( 3, 4 ] 46895 6.803% 89.137% # ( 4, 6 ] 48568 7.046% 96.183% # ( 6, 10 ] 14217 2.062% 98.245% ( 10, 15 ] 2786 0.404% 98.649% ( 15, 22 ] 385 0.056% 98.705% ( 22, 34 ] 42 0.006% 98.711% ( 34, 51 ] 19 0.003% 98.714% ( 51, 76 ] 18 0.003% 98.717% ( 76, 110 ] 708 0.103% 98.819% ( 110, 170 ] 2796 0.406% 99.225% ( 170, 250 ] 1636 0.237% 99.462% ( 250, 380 ] 1042 0.151% 99.613% ( 380, 580 ] 1058 0.153% 99.767% ( 580, 870 ] 681 0.099% 99.866% ( 870, 1300 ] 458 0.066% 99.932% ( 1300, 1900 ] 287 0.042% 99.974% ( 1900, 2900 ] 236 0.034% 100.008% ( 2900, 4400 ] 197 0.029% 100.037% ( 4400, 6600 ] 57 0.008% 100.045% ( 6600, 9900 ] 3 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 97333 Average: 8.5778 StdDev: 107.57 Min: 1 Median: 1.9035 Max: 8381 Percentiles: P50: 1.90 P75: 2.85 P99: 30.75 P99.9: 1518.61 P99.99: 4303.71 ------------------------------------------------------ [ 0, 1 ] 3525 3.622% 3.622% # ( 1, 2 ] 49965 51.334% 54.956% ########## ( 2, 3 ] 23068 23.700% 78.656% ##### ( 3, 4 ] 8154 8.377% 87.033% ## ( 4, 6 ] 8298 8.525% 95.559% ## ( 6, 10 ] 2782 2.858% 98.417% # ( 10, 15 ] 451 0.463% 98.880% ( 15, 22 ] 106 0.109% 98.989% ( 22, 34 ] 16 0.016% 99.005% ( 34, 51 ] 1 0.001% 99.007% ( 51, 76 ] 2 0.002% 99.009% ( 76, 110 ] 103 0.106% 99.114% ( 110, 170 ] 339 0.348% 99.463% ( 170, 250 ] 143 0.147% 99.610% ( 250, 380 ] 67 0.069% 99.678% ( 380, 580 ] 69 0.071% 99.749% ( 580, 870 ] 67 0.069% 99.818% ( 870, 1300 ] 65 0.067% 99.885% ( 1300, 1900 ] 43 0.044% 99.929% ( 1900, 2900 ] 35 0.036% 99.965% ( 2900, 4400 ] 27 0.028% 99.993% ( 4400, 6600 ] 4 0.004% 99.997% ( 6600, 9900 ] 4 0.004% 100.001% ** Level 2 read latency histogram (micros): Count: 135124 Average: 9.4521 StdDev: 130.03 Min: 1 Median: 1.9795 Max: 9392 Percentiles: P50: 1.98 P75: 3.03 P99: 11.58 P99.9: 1589.46 P99.99: 3661.08 ------------------------------------------------------ [ 0, 1 ] 3717 2.751% 2.751% # ( 1, 2 ] 65184 48.240% 50.991% ########## ( 2, 3 ] 32023 23.699% 74.690% ##### ( 3, 4 ] 13565 10.039% 84.729% ## ( 4, 6 ] 14644 10.837% 95.566% ## ( 6, 10 ] 4380 3.241% 98.808% # ( 10, 15 ] 824 0.610% 99.418% ( 15, 22 ] 101 0.075% 99.492% ( 22, 34 ] 23 0.017% 99.509% ( 34, 51 ] 13 0.010% 99.519% ( 51, 76 ] 8 0.006% 99.525% ( 76, 110 ] 4 0.003% 99.528% ( 110, 170 ] 36 0.027% 99.554% ( 170, 250 ] 37 0.027% 99.582% ( 250, 380 ] 78 0.058% 99.640% ( 380, 580 ] 90 0.067% 99.706% ( 580, 870 ] 129 0.095% 99.802% ( 870, 1300 ] 102 0.075% 99.877% ( 1300, 1900 ] 64 0.047% 99.925% ( 1900, 2900 ] 55 0.041% 99.965% ( 2900, 4400 ] 66 0.049% 100.014% ( 4400, 6600 ] 15 0.011% 100.025% ( 6600, 9900 ] 5 0.004% 100.029% ** Level 3 read latency histogram (micros): Count: 848707 Average: 11.4808 StdDev: 140.89 Min: 1 Median: 2.0266 Max: 11106 Percentiles: P50: 2.03 P75: 3.11 P99: 11.56 P99.9: 1013.88 P99.99: 1370.84 ------------------------------------------------------ [ 0, 1 ] 15562 1.834% 1.834% ( 1, 2 ] 403250 47.513% 49.347% ########## ( 2, 3 ] 208039 24.512% 73.860% ##### ( 3, 4 ] 91866 10.824% 84.684% ## ( 4, 6 ] 93514 11.018% 95.702% ## ( 6, 10 ] 26252 3.093% 98.795% # ( 10, 15 ] 5584 0.658% 99.453% ( 15, 22 ] 625 0.074% 99.527% ( 22, 34 ] 60 0.007% 99.534% ( 34, 51 ] 35 0.004% 99.538% ( 51, 76 ] 52 0.006% 99.544% ( 76, 110 ] 96 0.011% 99.556% ( 110, 170 ] 331 0.039% 99.595% ( 170, 250 ] 286 0.034% 99.628% ( 250, 380 ] 348 0.041% 99.669% ( 380, 580 ] 720 0.085% 99.754% ( 580, 870 ] 897 0.106% 99.860% ( 870, 1300 ] 1020 0.120% 99.980% ( 1300, 1900 ] 721 0.085% 100.065% ( 1900, 2900 ] 558 0.066% 100.131% ( 2900, 4400 ] 495 0.058% 100.189% ( 4400, 6600 ] 105 0.012% 100.201% ( 6600, 9900 ] 21 0.002% 100.204% ( 9900, 14000 ] 1 0.000% 100.204% ** Level 4 read latency histogram (micros): Count: 417283 Average: 24.9762 StdDev: 213.58 Min: 0 Median: 2.0422 Max: 10280 Percentiles: P50: 2.04 P75: 3.22 P99: 592.11 P99.9: 2688.38 P99.99: 3606.51 ------------------------------------------------------ [ 0, 1 ] 7506 1.799% 1.799% ( 1, 2 ] 196960 47.201% 48.999% ######### ( 2, 3 ] 98896 23.700% 72.699% ##### ( 3, 4 ] 43613 10.452% 83.151% ## ( 4, 6 ] 44296 10.615% 93.766% ## ( 6, 10 ] 12087 2.897% 96.663% # ( 10, 15 ] 2409 0.577% 97.240% ( 15, 22 ] 270 0.065% 97.305% ( 22, 34 ] 20 0.005% 97.310% ( 34, 51 ] 23 0.006% 97.315% ( 51, 76 ] 33 0.008% 97.323% ( 76, 110 ] 767 0.184% 97.507% ( 110, 170 ] 2536 0.608% 98.115% ( 170, 250 ] 1492 0.358% 98.472% ( 250, 380 ] 960 0.230% 98.702% ( 380, 580 ] 1186 0.284% 98.987% ( 580, 870 ] 1345 0.322% 99.309% ( 870, 1300 ] 1142 0.274% 99.583% ( 1300, 1900 ] 817 0.196% 99.778% ( 1900, 2900 ] 644 0.154% 99.933% ( 2900, 4400 ] 508 0.122% 100.054% ( 4400, 6600 ] 138 0.033% 100.087% ( 6600, 9900 ] 15 0.004% 100.091% ( 9900, 14000 ] 1 0.000% 100.091% ** Level 5 read latency histogram (micros): Count: 57202 Average: 546.7483 StdDev: 880.31 Min: 77 Median: 216.2646 Max: 15561 Percentiles: P50: 216.26 P75: 527.29 P99: 4681.87 P99.9: 7806.13 P99.99: 9758.89 ------------------------------------------------------ ( 76, 110 ] 5208 9.105% 9.105% ## ( 110, 170 ] 17640 30.838% 39.943% ###### ( 170, 250 ] 9948 17.391% 57.334% ### ( 250, 380 ] 5860 10.244% 67.578% ## ( 380, 580 ] 5765 10.078% 77.656% ## ( 580, 870 ] 4271 7.467% 85.123% # ( 870, 1300 ] 2852 4.986% 90.109% # ( 1300, 1900 ] 1879 3.285% 93.394% # ( 1900, 2900 ] 1603 2.802% 96.196% # ( 2900, 4400 ] 1533 2.680% 98.876% # ( 4400, 6600 ] 554 0.968% 99.844% ( 6600, 9900 ] 87 0.152% 99.997% ( 9900, 14000 ] 1 0.002% 99.998% ( 14000, 22000 ] 1 0.002% 100.000% ** DB Stats ** Uptime(secs): 11.3 total, 3.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 174.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.590 H:M:S, 31.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 255.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.311 H:M:S, 8.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-09:00:45 ... thread 0: (1000000,3000000) ops and (289443.1,206472.3) ops/second in (3.454910,14.529797) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/6 3.84 GB 258.0 2.5 0.0 2.5 5.3 2.8 0.0 1.9 104.8 219.7 24.65 17.69 49 0.503 2622K 2851 0.0 0.0 L1 7/7 852.56 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 53.83 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/0 989.24 MB 1.0 1.6 0.9 0.8 1.6 0.8 0.0 1.9 98.7 97.7 17.10 7.78 10 1.710 944K 0 0.0 0.0 L4 163/0 9.50 GB 1.0 4.7 3.2 1.6 4.7 3.1 0.0 1.5 112.1 111.1 43.29 22.24 31 1.396 1658K 0 0.0 0.0 L5 1124/0 92.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1331/13 107.59 GB 0.0 8.9 4.0 4.9 11.6 6.7 3.3 4.2 107.3 139.9 85.04 47.71 90 0.945 5224K 2851 0.0 0.0 Int 0/0 0.00 KB 0.0 8.9 4.0 4.9 11.6 6.7 3.3 4.2 107.3 139.9 85.04 47.71 90 0.945 5224K 2851 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.9 4.0 4.9 8.8 4.0 0.0 0.0 127.0 126.2 71.82 39.78 50 1.436 5224K 2851 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 214.5 13.22 7.93 40 0.330 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.7 total, 14.5 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.62 GB write, 808.96 MB/s write, 8.91 GB read, 620.42 MB/s read, 85.0 seconds Interval compaction: 11.62 GB write, 818.62 MB/s write, 8.91 GB read, 627.83 MB/s read, 85.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 49, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 960448 Average: 9.2493 StdDev: 92.42 Min: 0 Median: 1.6601 Max: 6994 Percentiles: P50: 1.66 P75: 2.40 P99: 167.52 P99.9: 851.93 P99.99: 1883.75 ------------------------------------------------------ [ 0, 1 ] 135273 14.084% 14.084% ### ( 1, 2 ] 522602 54.412% 68.497% ########### ( 2, 3 ] 157887 16.439% 84.936% ### ( 3, 4 ] 54707 5.696% 90.632% # ( 4, 6 ] 53793 5.601% 96.232% # ( 6, 10 ] 15243 1.587% 97.819% ( 10, 15 ] 3027 0.315% 98.135% ( 15, 22 ] 415 0.043% 98.178% ( 22, 34 ] 45 0.005% 98.183% ( 34, 51 ] 21 0.002% 98.185% ( 51, 76 ] 19 0.002% 98.187% ( 76, 110 ] 1635 0.170% 98.357% ( 110, 170 ] 6443 0.671% 99.028% ( 170, 250 ] 3642 0.379% 99.407% ( 250, 380 ] 2036 0.212% 99.619% ( 380, 580 ] 1805 0.188% 99.807% ( 580, 870 ] 954 0.099% 99.906% ( 870, 1300 ] 516 0.054% 99.960% ( 1300, 1900 ] 297 0.031% 99.991% ( 1900, 2900 ] 248 0.026% 100.017% ( 2900, 4400 ] 202 0.021% 100.038% ( 4400, 6600 ] 57 0.006% 100.044% ( 6600, 9900 ] 3 0.000% 100.044% ** Level 1 read latency histogram (micros): Count: 192517 Average: 6.5776 StdDev: 78.04 Min: 1 Median: 1.9523 Max: 8381 Percentiles: P50: 1.95 P75: 2.94 P99: 16.88 P99.9: 843.09 P99.99: 3774.91 ------------------------------------------------------ [ 0, 1 ] 7276 3.779% 3.779% # ( 1, 2 ] 93444 48.538% 52.317% ########## ( 2, 3 ] 46605 24.208% 76.526% ##### ( 3, 4 ] 17867 9.281% 85.806% ## ( 4, 6 ] 18327 9.520% 95.326% ## ( 6, 10 ] 5962 3.097% 98.423% # ( 10, 15 ] 1029 0.534% 98.957% ( 15, 22 ] 305 0.158% 99.116% ( 22, 34 ] 39 0.020% 99.136% ( 34, 51 ] 2 0.001% 99.137% ( 51, 76 ] 2 0.001% 99.138% ( 76, 110 ] 211 0.110% 99.248% ( 110, 170 ] 643 0.334% 99.582% ( 170, 250 ] 297 0.154% 99.736% ( 250, 380 ] 119 0.062% 99.798% ( 380, 580 ] 123 0.064% 99.862% ( 580, 870 ] 81 0.042% 99.904% ( 870, 1300 ] 70 0.036% 99.940% ( 1300, 1900 ] 45 0.023% 99.964% ( 1900, 2900 ] 35 0.018% 99.982% ( 2900, 4400 ] 27 0.014% 99.996% ( 4400, 6600 ] 4 0.002% 99.998% ( 6600, 9900 ] 4 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 135164 Average: 9.5164 StdDev: 130.11 Min: 1 Median: 1.9798 Max: 9392 Percentiles: P50: 1.98 P75: 3.03 P99: 11.82 P99.9: 1589.09 P99.99: 3660.99 ------------------------------------------------------ [ 0, 1 ] 3717 2.750% 2.750% # ( 1, 2 ] 65184 48.226% 50.976% ########## ( 2, 3 ] 32023 23.692% 74.668% ##### ( 3, 4 ] 13565 10.036% 84.704% ## ( 4, 6 ] 14644 10.834% 95.538% ## ( 6, 10 ] 4380 3.241% 98.779% # ( 10, 15 ] 824 0.610% 99.388% ( 15, 22 ] 101 0.075% 99.463% ( 22, 34 ] 23 0.017% 99.480% ( 34, 51 ] 13 0.010% 99.490% ( 51, 76 ] 8 0.006% 99.495% ( 76, 110 ] 7 0.005% 99.501% ( 110, 170 ] 56 0.041% 99.542% ( 170, 250 ] 46 0.034% 99.576% ( 250, 380 ] 82 0.061% 99.637% ( 380, 580 ] 91 0.067% 99.704% ( 580, 870 ] 130 0.096% 99.800% ( 870, 1300 ] 104 0.077% 99.877% ( 1300, 1900 ] 64 0.047% 99.925% ( 1900, 2900 ] 55 0.041% 99.965% ( 2900, 4400 ] 66 0.049% 100.014% ( 4400, 6600 ] 15 0.011% 100.025% ( 6600, 9900 ] 5 0.004% 100.029% ** Level 3 read latency histogram (micros): Count: 849456 Average: 11.6514 StdDev: 141.02 Min: 1 Median: 2.0284 Max: 11106 Percentiles: P50: 2.03 P75: 3.11 P99: 12.19 P99.9: 1015.24 P99.99: 1370.78 ------------------------------------------------------ [ 0, 1 ] 15562 1.832% 1.832% ( 1, 2 ] 403255 47.472% 49.304% ######### ( 2, 3 ] 208054 24.493% 73.797% ##### ( 3, 4 ] 91872 10.815% 84.612% ## ( 4, 6 ] 93523 11.010% 95.622% ## ( 6, 10 ] 26254 3.091% 98.713% # ( 10, 15 ] 5584 0.657% 99.370% ( 15, 22 ] 625 0.074% 99.444% ( 22, 34 ] 60 0.007% 99.451% ( 34, 51 ] 35 0.004% 99.455% ( 51, 76 ] 52 0.006% 99.461% ( 76, 110 ] 187 0.022% 99.483% ( 110, 170 ] 621 0.073% 99.556% ( 170, 250 ] 465 0.055% 99.611% ( 250, 380 ] 414 0.049% 99.659% ( 380, 580 ] 782 0.092% 99.751% ( 580, 870 ] 915 0.108% 99.859% ( 870, 1300 ] 1026 0.121% 99.980% ( 1300, 1900 ] 721 0.085% 100.065% ( 1900, 2900 ] 558 0.066% 100.131% ( 2900, 4400 ] 495 0.058% 100.189% ( 4400, 6600 ] 105 0.012% 100.201% ( 6600, 9900 ] 21 0.002% 100.204% ( 9900, 14000 ] 1 0.000% 100.204% ** Level 4 read latency histogram (micros): Count: 424174 Average: 27.8168 StdDev: 213.84 Min: 0 Median: 2.0768 Max: 10280 Percentiles: P50: 2.08 P75: 3.34 P99: 616.20 P99.9: 2677.68 P99.99: 3603.09 ------------------------------------------------------ [ 0, 1 ] 7506 1.770% 1.770% ( 1, 2 ] 196980 46.438% 48.208% ######### ( 2, 3 ] 98983 23.335% 71.544% ##### ( 3, 4 ] 43663 10.294% 81.837% ## ( 4, 6 ] 44392 10.466% 92.303% ## ( 6, 10 ] 12101 2.853% 95.156% # ( 10, 15 ] 2413 0.569% 95.724% ( 15, 22 ] 270 0.064% 95.788% ( 22, 34 ] 20 0.005% 95.793% ( 34, 51 ] 23 0.005% 95.798% ( 51, 76 ] 36 0.008% 95.807% ( 76, 110 ] 1688 0.398% 96.205% ( 110, 170 ] 5503 1.297% 97.502% ( 170, 250 ] 2866 0.676% 98.178% ( 250, 380 ] 1589 0.375% 98.552% ( 380, 580 ] 1710 0.403% 98.955% ( 580, 870 ] 1516 0.357% 99.313% ( 870, 1300 ] 1170 0.276% 99.589% ( 1300, 1900 ] 820 0.193% 99.782% ( 1900, 2900 ] 644 0.152% 99.934% ( 2900, 4400 ] 509 0.120% 100.054% ( 4400, 6600 ] 138 0.033% 100.086% ( 6600, 9900 ] 15 0.004% 100.090% ( 9900, 14000 ] 1 0.000% 100.090% ** Level 5 read latency histogram (micros): Count: 100456 Average: 402.0844 StdDev: 692.25 Min: 71 Median: 179.8727 Max: 15561 Percentiles: P50: 179.87 P75: 357.61 P99: 4044.96 P99.9: 6546.56 P99.99: 9518.96 ------------------------------------------------------ ( 51, 76 ] 6 0.006% 0.006% ( 76, 110 ] 11014 10.964% 10.970% ## ( 110, 170 ] 36853 36.686% 47.656% ####### ( 170, 250 ] 19083 18.996% 66.652% #### ( 250, 380 ] 10131 10.085% 76.737% ## ( 380, 580 ] 9196 9.154% 85.891% ## ( 580, 870 ] 5399 5.374% 91.266% # ( 870, 1300 ] 3065 3.051% 94.317% # ( 1300, 1900 ] 1905 1.896% 96.213% ( 1900, 2900 ] 1627 1.620% 97.833% ( 2900, 4400 ] 1536 1.529% 99.362% ( 4400, 6600 ] 554 0.551% 99.913% ( 6600, 9900 ] 87 0.087% 100.000% ( 9900, 14000 ] 1 0.001% 100.001% ( 14000, 22000 ] 1 0.001% 100.002% ** DB Stats ** Uptime(secs): 14.7 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 200.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.590 H:M:S, 24.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 284.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 214.131 micros/op 18649 ops/sec 60.164 seconds 1121996 operations; 18.1 MB/s (271999 of 271999 found) Microseconds per read: Count: 1121996 Average: 214.1323 StdDev: 583.54 Min: 2 Median: 164.8618 Max: 83985 Percentiles: P50: 164.86 P75: 222.07 P99: 811.01 P99.9: 8601.96 P99.99: 24988.72 ------------------------------------------------------ ( 1, 2 ] 5 0.000% 0.000% ( 2, 3 ] 47 0.004% 0.005% ( 3, 4 ] 59 0.005% 0.010% ( 4, 6 ] 103 0.009% 0.019% ( 6, 10 ] 388 0.035% 0.054% ( 10, 15 ] 3622 0.323% 0.376% ( 15, 22 ] 5578 0.497% 0.874% ( 22, 34 ] 9744 0.868% 1.742% ( 34, 51 ] 2859 0.255% 1.997% ( 51, 76 ] 264 0.024% 2.020% ( 76, 110 ] 27047 2.411% 4.431% ( 110, 170 ] 559167 49.837% 54.268% ########## ( 170, 250 ] 357365 31.851% 86.119% ###### ( 250, 380 ] 102815 9.164% 95.282% ## ( 380, 580 ] 32960 2.938% 98.220% # ( 580, 870 ] 10988 0.979% 99.199% ( 870, 1300 ] 3934 0.351% 99.550% ( 1300, 1900 ] 1640 0.146% 99.696% ( 1900, 2900 ] 1086 0.097% 99.793% ( 2900, 4400 ] 824 0.073% 99.866% ( 4400, 6600 ] 251 0.022% 99.889% ( 6600, 9900 ] 211 0.019% 99.907% ( 9900, 14000 ] 464 0.041% 99.949% ( 14000, 22000 ] 434 0.039% 99.987% ( 22000, 33000 ] 106 0.009% 99.997% ( 33000, 50000 ] 24 0.002% 99.999% ( 50000, 75000 ] 10 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 19375893 rocksdb.bloom.filter.full.positive COUNT : 1309633 rocksdb.bloom.filter.full.true.positive COUNT : 1121589 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 407 rocksdb.memtable.miss COUNT : 1121589 rocksdb.l0.hit COUNT : 37291 rocksdb.l1.hit COUNT : 20004 rocksdb.l2andup.hit COUNT : 1064294 rocksdb.compaction.key.drop.new COUNT : 119771 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3544885 rocksdb.number.keys.read COUNT : 1121996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3658321320 rocksdb.bytes.read COUNT : 1121996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1514 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 46359046 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 14495638239 rocksdb.compact.write.bytes COUNT : 14377686769 rocksdb.flush.write.bytes COUNT : 3633207438 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 21 rocksdb.number.superversion_acquires COUNT : 678 rocksdb.number.superversion_releases COUNT : 650 rocksdb.number.superversion_cleanups COUNT : 171 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 165 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3603868672 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1362944 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 19505541602 rocksdb.non.last.level.read.count COUNT : 4571786 rocksdb.block.checksum.compute.count COUNT : 4834658 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 164.112636 P95 : 375.558613 P99 : 810.117255 P100 : 83982.000000 COUNT : 1121996 SUM : 239351589 rocksdb.db.write.micros P50 : 1.586057 P95 : 4.824588 P99 : 14.222504 P100 : 735223.000000 COUNT : 3544885 SUM : 55526520 rocksdb.compaction.times.micros P50 : 1398333.333333 P95 : 2487500.000000 P99 : 15179833.000000 P100 : 15179833.000000 COUNT : 53 SUM : 88941890 rocksdb.compaction.times.cpu_micros P50 : 797857.142857 P95 : 1515000.000000 P99 : 8051000.000000 P100 : 9582072.000000 COUNT : 53 SUM : 51262689 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 762.592593 P95 : 210000.000000 P99 : 315000.000000 P100 : 367394.000000 COUNT : 50 SUM : 1056679 rocksdb.compaction.outfile.sync.micros P50 : 43928.571429 P95 : 314000.000000 P99 : 433200.000000 P100 : 1068862.000000 COUNT : 172 SUM : 14880452 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 234.615385 P95 : 4293.750000 P99 : 5317.000000 P100 : 5317.000000 COUNT : 117 SUM : 126849 rocksdb.table.open.io.micros P50 : 8683.503055 P95 : 19839.130435 P99 : 26594.615385 P100 : 28722.000000 COUNT : 1514 SUM : 13685013 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.279696 P95 : 110.360615 P99 : 192.443771 P100 : 11126.000000 COUNT : 3512026 SUM : 63755371 rocksdb.read.block.get.micros P50 : 135.179260 P95 : 247.823748 P99 : 748.221586 P100 : 15633.000000 COUNT : 1321129 SUM : 202162170 rocksdb.write.raw.block.micros P50 : 0.551658 P95 : 1.603384 P99 : 3.573521 P100 : 14987.000000 COUNT : 4362496 SUM : 12377444 rocksdb.numfiles.in.singlecompaction P50 : 2.735294 P95 : 3.986538 P99 : 37.000000 P100 : 37.000000 COUNT : 67 SUM : 245 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.601185 P95 : 2290.362675 P99 : 2778.676993 P100 : 735059.000000 COUNT : 161571 SUM : 46374707 rocksdb.sst.read.micros P50 : 2.861392 P95 : 168.859756 P99 : 429.655098 P100 : 15561.000000 COUNT : 4571836 SUM : 252129594 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1121996 SUM : 1121996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3544885 SUM : 3658321320 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 220000.000000 P95 : 916666.666667 P99 : 968071.000000 P100 : 968071.000000 COUNT : 50 SUM : 15220179 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 177 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0