[2024-07-13 16:28:10.554331] Starting SPDK v24.09-pre git sha1 719d03c6a / DPDK 22.11.4 initialization... [2024-07-13 16:28:10.554617] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3642238 ] Set seed to 1720880890547955 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-13 16:28:10.647582] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-13 16:28:10.685357] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-13 16:28:10.685406] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3642238' to capture a snapshot of events at runtime. [2024-07-13 16:28:10.685416] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-13 16:28:10.685429] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-13 16:28:10.685437] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3642238 for offline analysis/debug. [2024-07-13 16:28:10.685522] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Jul 13 16:28:14 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/13-16:28:23 ... thread 0: (1000000,1000000) ops and (123701.1,123701.1) ops/second in (8.084000,8.084000) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 1.87 GB 50.4 0.3 0.0 0.3 1.2 0.9 0.0 1.4 31.8 121.0 9.89 3.80 11 0.899 319K 375 0.0 0.0 L1 7/7 782.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 82.35 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 23/5 1.56 GB 1.0 1.0 0.5 0.5 1.0 0.5 0.1 2.1 94.5 93.3 10.95 4.99 5 2.189 766K 6208 0.0 0.0 L4 172/22 10.25 GB 1.0 4.8 2.8 2.1 4.7 2.7 0.0 1.7 106.0 104.2 46.62 23.15 25 1.865 1243K 0 0.0 0.0 L5 1116/0 91.97 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1328/40 106.49 GB 0.0 6.1 3.2 2.9 6.9 4.0 2.1 8.0 93.3 104.9 67.46 31.95 41 1.645 2330K 6583 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 3.2 2.9 6.9 4.0 2.1 8.0 93.3 104.9 67.46 31.95 41 1.645 2330K 6583 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 3.2 2.9 6.0 3.1 0.0 0.0 104.9 103.3 59.96 29.41 31 1.934 2330K 6583 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 117.6 7.50 2.53 10 0.750 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.2 total, 8.1 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.91 GB write, 857.97 MB/s write, 6.14 GB read, 762.82 MB/s read, 67.5 seconds Interval compaction: 6.91 GB write, 875.06 MB/s write, 6.14 GB read, 778.02 MB/s read, 67.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 24, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 378684 Average: 12.4130 StdDev: 186.47 Min: 1 Median: 1.9659 Max: 34976 Percentiles: P50: 1.97 P75: 2.95 P99: 11.49 P99.9: 2106.34 P99.99: 3825.29 ------------------------------------------------------ [ 0, 1 ] 9945 2.626% 2.626% # ( 1, 2 ] 185737 49.048% 51.674% ########## ( 2, 3 ] 92571 24.445% 76.120% ##### ( 3, 4 ] 37237 9.833% 85.953% ## ( 4, 6 ] 39567 10.449% 96.401% ## ( 6, 10 ] 9309 2.458% 98.860% ( 10, 15 ] 1797 0.475% 99.334% ( 15, 22 ] 234 0.062% 99.396% ( 22, 34 ] 35 0.009% 99.405% ( 34, 51 ] 23 0.006% 99.411% ( 51, 76 ] 24 0.006% 99.418% ( 76, 110 ] 13 0.003% 99.421% ( 110, 170 ] 37 0.010% 99.431% ( 170, 250 ] 59 0.016% 99.447% ( 250, 380 ] 162 0.043% 99.489% ( 380, 580 ] 333 0.088% 99.577% ( 580, 870 ] 428 0.113% 99.690% ( 870, 1300 ] 443 0.117% 99.807% ( 1300, 1900 ] 305 0.081% 99.888% ( 1900, 2900 ] 239 0.063% 99.951% ( 2900, 4400 ] 245 0.065% 100.016% ( 4400, 6600 ] 68 0.018% 100.034% ( 6600, 9900 ] 16 0.004% 100.038% ( 9900, 14000 ] 1 0.000% 100.038% ( 14000, 22000 ] 2 0.001% 100.039% ( 22000, 33000 ] 4 0.001% 100.040% ( 33000, 50000 ] 1 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 16056 Average: 26.8331 StdDev: 261.11 Min: 1 Median: 1.8064 Max: 8070 Percentiles: P50: 1.81 P75: 2.74 P99: 797.12 P99.9: 4135.48 P99.99: 8070.00 ------------------------------------------------------ [ 0, 1 ] 919 5.724% 5.724% # ( 1, 2 ] 8816 54.908% 60.632% ########### ( 2, 3 ] 3108 19.357% 79.989% #### ( 3, 4 ] 1259 7.841% 87.830% ## ( 4, 6 ] 1263 7.866% 95.696% ## ( 6, 10 ] 373 2.323% 98.019% ( 10, 15 ] 62 0.386% 98.406% ( 15, 22 ] 14 0.087% 98.493% ( 51, 76 ] 1 0.006% 98.499% ( 76, 110 ] 1 0.006% 98.505% ( 110, 170 ] 1 0.006% 98.511% ( 170, 250 ] 4 0.025% 98.536% ( 250, 380 ] 14 0.087% 98.624% ( 380, 580 ] 26 0.162% 98.786% ( 580, 870 ] 46 0.286% 99.072% ( 870, 1300 ] 49 0.305% 99.377% ( 1300, 1900 ] 29 0.181% 99.558% ( 1900, 2900 ] 36 0.224% 99.782% ( 2900, 4400 ] 23 0.143% 99.925% ( 4400, 6600 ] 9 0.056% 99.981% ( 6600, 9900 ] 3 0.019% 100.000% ** Level 2 read latency histogram (micros): Count: 126254 Average: 10.7294 StdDev: 202.00 Min: 1 Median: 1.9921 Max: 27131 Percentiles: P50: 1.99 P75: 3.09 P99: 12.03 P99.9: 1539.43 P99.99: 3015.04 ------------------------------------------------------ [ 0, 1 ] 4046 3.205% 3.205% # ( 1, 2 ] 59553 47.169% 50.374% ######### ( 2, 3 ] 29840 23.635% 74.009% ##### ( 3, 4 ] 13341 10.567% 84.576% ## ( 4, 6 ] 13683 10.838% 95.413% ## ( 6, 10 ] 4190 3.319% 98.732% # ( 10, 15 ] 832 0.659% 99.391% ( 15, 22 ] 123 0.097% 99.488% ( 22, 34 ] 33 0.026% 99.514% ( 34, 51 ] 14 0.011% 99.526% ( 51, 76 ] 9 0.007% 99.533% ( 76, 110 ] 6 0.005% 99.537% ( 110, 170 ] 28 0.022% 99.560% ( 170, 250 ] 41 0.032% 99.592% ( 250, 380 ] 69 0.055% 99.647% ( 380, 580 ] 110 0.087% 99.734% ( 580, 870 ] 107 0.085% 99.819% ( 870, 1300 ] 80 0.063% 99.882% ( 1300, 1900 ] 57 0.045% 99.927% ( 1900, 2900 ] 76 0.060% 99.987% ( 2900, 4400 ] 44 0.035% 100.022% ( 4400, 6600 ] 17 0.013% 100.036% ( 6600, 9900 ] 10 0.008% 100.044% ( 9900, 14000 ] 2 0.002% 100.045% ( 14000, 22000 ] 1 0.001% 100.046% ( 22000, 33000 ] 4 0.003% 100.049% ** Level 3 read latency histogram (micros): Count: 705487 Average: 10.3937 StdDev: 166.39 Min: 1 Median: 1.9819 Max: 33731 Percentiles: P50: 1.98 P75: 2.98 P99: 9.64 P99.9: 846.47 P99.99: 1372.54 ------------------------------------------------------ [ 0, 1 ] 12911 1.830% 1.830% ( 1, 2 ] 346108 49.059% 50.890% ########## ( 2, 3 ] 173078 24.533% 75.423% ##### ( 3, 4 ] 72259 10.242% 85.665% ## ( 4, 6 ] 77176 10.939% 96.604% ## ( 6, 10 ] 18560 2.631% 99.235% # ( 10, 15 ] 3176 0.450% 99.685% ( 15, 22 ] 386 0.055% 99.740% ( 22, 34 ] 41 0.006% 99.746% ( 34, 51 ] 49 0.007% 99.753% ( 51, 76 ] 49 0.007% 99.760% ( 76, 110 ] 28 0.004% 99.764% ( 110, 170 ] 33 0.005% 99.769% ( 170, 250 ] 48 0.007% 99.775% ( 250, 380 ] 135 0.019% 99.794% ( 380, 580 ] 286 0.041% 99.835% ( 580, 870 ] 499 0.071% 99.906% ( 870, 1300 ] 545 0.077% 99.983% ( 1300, 1900 ] 409 0.058% 100.041% ( 1900, 2900 ] 374 0.053% 100.094% ( 2900, 4400 ] 440 0.062% 100.156% ( 4400, 6600 ] 105 0.015% 100.171% ( 6600, 9900 ] 32 0.005% 100.176% ( 9900, 14000 ] 3 0.000% 100.176% ( 14000, 22000 ] 3 0.000% 100.177% ( 22000, 33000 ] 4 0.001% 100.177% ( 33000, 50000 ] 1 0.000% 100.177% ** Level 4 read latency histogram (micros): Count: 611538 Average: 19.1596 StdDev: 207.46 Min: 0 Median: 1.9992 Max: 43213 Percentiles: P50: 2.00 P75: 3.01 P99: 109.60 P99.9: 2050.52 P99.99: 2843.58 ------------------------------------------------------ [ 0, 1 ] 11026 1.803% 1.803% ( 1, 2 ] 294977 48.235% 50.038% ########## ( 2, 3 ] 151844 24.830% 74.868% ##### ( 3, 4 ] 63032 10.307% 85.175% ## ( 4, 6 ] 64957 10.622% 95.797% ## ( 6, 10 ] 16295 2.665% 98.462% # ( 10, 15 ] 2789 0.456% 98.918% ( 15, 22 ] 348 0.057% 98.975% ( 22, 34 ] 28 0.005% 98.979% ( 34, 51 ] 49 0.008% 98.987% ( 51, 76 ] 47 0.008% 98.995% ( 76, 110 ] 32 0.005% 99.000% ( 110, 170 ] 64 0.010% 99.011% ( 170, 250 ] 184 0.030% 99.041% ( 250, 380 ] 392 0.064% 99.105% ( 380, 580 ] 816 0.133% 99.238% ( 580, 870 ] 1500 0.245% 99.484% ( 870, 1300 ] 1502 0.246% 99.729% ( 1300, 1900 ] 942 0.154% 99.883% ( 1900, 2900 ] 694 0.113% 99.997% ( 2900, 4400 ] 676 0.111% 100.107% ( 4400, 6600 ] 168 0.027% 100.135% ( 6600, 9900 ] 32 0.005% 100.140% ( 9900, 14000 ] 3 0.000% 100.140% ( 22000, 33000 ] 1 0.000% 100.141% ( 33000, 50000 ] 1 0.000% 100.141% ** Level 5 read latency histogram (micros): Count: 14232 Average: 1659.3474 StdDev: 2067.52 Min: 84 Median: 1089.8737 Max: 90102 Percentiles: P50: 1089.87 P75: 2188.98 P99: 6842.75 P99.9: 24160.89 P99.99: 85094.00 ------------------------------------------------------ ( 76, 110 ] 20 0.141% 0.141% ( 110, 170 ] 122 0.857% 0.998% ( 170, 250 ] 320 2.248% 3.246% ( 250, 380 ] 848 5.958% 9.205% # ( 380, 580 ] 1793 12.598% 21.803% ### ( 580, 870 ] 2637 18.529% 40.332% #### ( 870, 1300 ] 2691 18.908% 59.240% #### ( 1300, 1900 ] 1800 12.648% 71.887% ### ( 1900, 2900 ] 1533 10.772% 82.659% ## ( 2900, 4400 ] 1633 11.474% 94.133% ## ( 4400, 6600 ] 684 4.806% 98.939% # ( 6600, 9900 ] 118 0.829% 99.768% ( 9900, 14000 ] 9 0.063% 99.831% ( 14000, 22000 ] 8 0.056% 99.888% ( 22000, 33000 ] 9 0.063% 99.951% ( 33000, 50000 ] 3 0.021% 99.972% ( 50000, 75000 ] 2 0.014% 99.986% ( 75000, 110000 ] 2 0.014% 100.000% ** DB Stats ** Uptime(secs): 8.2 total, 8.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 119.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.937 H:M:S, 47.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 121.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.937 H:M:S, 48.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/13-16:28:26 ... thread 0: (1000000,2000000) ops and (279878.2,171571.0) ops/second in (3.572983,11.656983) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/6 2.85 GB 163.6 1.5 0.0 1.5 3.3 1.8 0.0 1.8 82.3 185.0 18.37 11.08 31 0.593 1535K 1836 0.0 0.0 L1 7/7 782.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 82.35 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 955.43 MB 1.0 1.0 0.5 0.5 1.0 0.5 0.1 2.1 94.5 93.3 10.95 4.99 5 2.189 766K 6208 0.0 0.0 L4 158/0 9.56 GB 1.0 6.2 3.4 2.8 6.1 3.3 0.0 1.8 111.3 109.4 56.87 29.40 30 1.896 1640K 0 0.0 0.0 L5 1132/0 93.26 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1329/13 107.45 GB 0.0 8.7 3.9 4.8 10.4 5.6 3.4 5.6 103.0 123.5 86.19 45.48 66 1.306 3942K 8044 0.0 0.0 Int 0/0 0.00 KB 0.0 8.7 3.9 4.8 10.4 5.6 3.4 5.6 103.0 123.5 86.19 45.48 66 1.306 3942K 8044 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.7 3.9 4.8 8.5 3.7 0.0 0.0 117.7 116.2 75.37 40.27 40 1.884 3942K 8044 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 174.7 10.82 5.20 26 0.416 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.8 total, 11.7 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.40 GB write, 900.56 MB/s write, 8.67 GB read, 750.75 MB/s read, 86.2 seconds Interval compaction: 10.40 GB write, 913.00 MB/s write, 8.67 GB read, 761.12 MB/s read, 86.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 24, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 679277 Average: 9.9413 StdDev: 142.81 Min: 1 Median: 1.7628 Max: 34976 Percentiles: P50: 1.76 P75: 2.61 P99: 114.34 P99.9: 1298.14 P99.99: 3067.10 ------------------------------------------------------ [ 0, 1 ] 56653 8.340% 8.340% ## ( 1, 2 ] 370992 54.616% 62.956% ########### ( 2, 3 ] 133151 19.602% 82.558% #### ( 3, 4 ] 48882 7.196% 89.754% # ( 4, 6 ] 48186 7.094% 96.848% # ( 6, 10 ] 11338 1.669% 98.517% ( 10, 15 ] 2193 0.323% 98.840% ( 15, 22 ] 287 0.042% 98.882% ( 22, 34 ] 39 0.006% 98.888% ( 34, 51 ] 26 0.004% 98.891% ( 51, 76 ] 27 0.004% 98.895% ( 76, 110 ] 566 0.083% 98.979% ( 110, 170 ] 1992 0.293% 99.272% ( 170, 250 ] 1327 0.195% 99.467% ( 250, 380 ] 842 0.124% 99.591% ( 380, 580 ] 895 0.132% 99.723% ( 580, 870 ] 678 0.100% 99.823% ( 870, 1300 ] 526 0.077% 99.900% ( 1300, 1900 ] 327 0.048% 99.948% ( 1900, 2900 ] 254 0.037% 99.986% ( 2900, 4400 ] 252 0.037% 100.023% ( 4400, 6600 ] 68 0.010% 100.033% ( 6600, 9900 ] 16 0.002% 100.035% ( 9900, 14000 ] 1 0.000% 100.035% ( 14000, 22000 ] 2 0.000% 100.036% ( 22000, 33000 ] 4 0.001% 100.036% ( 33000, 50000 ] 1 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 128333 Average: 6.9896 StdDev: 95.65 Min: 1 Median: 1.8218 Max: 8070 Percentiles: P50: 1.82 P75: 2.66 P99: 12.55 P99.9: 1120.27 P99.99: 4347.92 ------------------------------------------------------ [ 0, 1 ] 5756 4.485% 4.485% # ( 1, 2 ] 71080 55.387% 59.872% ########### ( 2, 3 ] 29204 22.756% 82.629% ##### ( 3, 4 ] 9185 7.157% 89.786% # ( 4, 6 ] 8346 6.503% 96.289% # ( 6, 10 ] 3257 2.538% 98.827% # ( 10, 15 ] 437 0.341% 99.168% ( 15, 22 ] 150 0.117% 99.285% ( 22, 34 ] 10 0.008% 99.292% ( 34, 51 ] 2 0.002% 99.294% ( 51, 76 ] 1 0.001% 99.295% ( 76, 110 ] 88 0.069% 99.363% ( 110, 170 ] 276 0.215% 99.578% ( 170, 250 ] 135 0.105% 99.684% ( 250, 380 ] 82 0.064% 99.748% ( 380, 580 ] 90 0.070% 99.818% ( 580, 870 ] 70 0.055% 99.872% ( 870, 1300 ] 63 0.049% 99.921% ( 1300, 1900 ] 30 0.023% 99.945% ( 1900, 2900 ] 36 0.028% 99.973% ( 2900, 4400 ] 24 0.019% 99.991% ( 4400, 6600 ] 9 0.007% 99.998% ( 6600, 9900 ] 3 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 126353 Average: 10.9506 StdDev: 202.24 Min: 1 Median: 1.9929 Max: 27131 Percentiles: P50: 1.99 P75: 3.10 P99: 12.62 P99.9: 1548.92 P99.99: 3014.71 ------------------------------------------------------ [ 0, 1 ] 4046 3.202% 3.202% # ( 1, 2 ] 59553 47.132% 50.334% ######### ( 2, 3 ] 29840 23.616% 73.951% ##### ( 3, 4 ] 13341 10.559% 84.509% ## ( 4, 6 ] 13683 10.829% 95.338% ## ( 6, 10 ] 4190 3.316% 98.655% # ( 10, 15 ] 832 0.658% 99.313% ( 15, 22 ] 123 0.097% 99.410% ( 22, 34 ] 33 0.026% 99.436% ( 34, 51 ] 14 0.011% 99.448% ( 51, 76 ] 9 0.007% 99.455% ( 76, 110 ] 15 0.012% 99.467% ( 110, 170 ] 58 0.046% 99.512% ( 170, 250 ] 71 0.056% 99.569% ( 250, 380 ] 76 0.060% 99.629% ( 380, 580 ] 124 0.098% 99.727% ( 580, 870 ] 112 0.089% 99.816% ( 870, 1300 ] 83 0.066% 99.881% ( 1300, 1900 ] 57 0.045% 99.926% ( 1900, 2900 ] 77 0.061% 99.987% ( 2900, 4400 ] 44 0.035% 100.022% ( 4400, 6600 ] 17 0.013% 100.036% ( 6600, 9900 ] 10 0.008% 100.044% ( 9900, 14000 ] 2 0.002% 100.045% ( 14000, 22000 ] 1 0.001% 100.046% ( 22000, 33000 ] 4 0.003% 100.049% ** Level 3 read latency histogram (micros): Count: 744644 Average: 10.2177 StdDev: 162.44 Min: 1 Median: 1.9744 Max: 33731 Percentiles: P50: 1.97 P75: 2.97 P99: 9.72 P99.9: 819.50 P99.99: 1329.76 ------------------------------------------------------ [ 0, 1 ] 14087 1.892% 1.892% ( 1, 2 ] 367634 49.370% 51.262% ########## ( 2, 3 ] 181520 24.377% 75.639% ##### ( 3, 4 ] 75474 10.136% 85.775% ## ( 4, 6 ] 80325 10.787% 96.562% ## ( 6, 10 ] 19519 2.621% 99.183% # ( 10, 15 ] 3295 0.442% 99.625% ( 15, 22 ] 405 0.054% 99.680% ( 22, 34 ] 41 0.006% 99.685% ( 34, 51 ] 50 0.007% 99.692% ( 51, 76 ] 49 0.007% 99.699% ( 76, 110 ] 104 0.014% 99.712% ( 110, 170 ] 235 0.032% 99.744% ( 170, 250 ] 182 0.024% 99.768% ( 250, 380 ] 201 0.027% 99.795% ( 380, 580 ] 339 0.046% 99.841% ( 580, 870 ] 532 0.071% 99.912% ( 870, 1300 ] 557 0.075% 99.987% ( 1300, 1900 ] 414 0.056% 100.043% ( 1900, 2900 ] 376 0.050% 100.093% ( 2900, 4400 ] 443 0.059% 100.153% ( 4400, 6600 ] 105 0.014% 100.167% ( 6600, 9900 ] 32 0.004% 100.171% ( 9900, 14000 ] 3 0.000% 100.172% ( 14000, 22000 ] 3 0.000% 100.172% ( 22000, 33000 ] 4 0.001% 100.173% ( 33000, 50000 ] 1 0.000% 100.173% ** Level 4 read latency histogram (micros): Count: 678318 Average: 19.8075 StdDev: 200.11 Min: 0 Median: 1.9886 Max: 43213 Percentiles: P50: 1.99 P75: 3.00 P99: 345.37 P99.9: 1929.91 P99.99: 2771.96 ------------------------------------------------------ [ 0, 1 ] 12555 1.851% 1.851% ( 1, 2 ] 330384 48.706% 50.557% ########## ( 2, 3 ] 165779 24.440% 74.997% ##### ( 3, 4 ] 67576 9.962% 84.959% ## ( 4, 6 ] 69086 10.185% 95.144% ## ( 6, 10 ] 17730 2.614% 97.758% # ( 10, 15 ] 2973 0.438% 98.196% ( 15, 22 ] 376 0.055% 98.252% ( 22, 34 ] 30 0.004% 98.256% ( 34, 51 ] 49 0.007% 98.263% ( 51, 76 ] 50 0.007% 98.271% ( 76, 110 ] 636 0.094% 98.364% ( 110, 170 ] 2113 0.312% 98.676% ( 170, 250 ] 1382 0.204% 98.880% ( 250, 380 ] 1112 0.164% 99.044% ( 380, 580 ] 1415 0.209% 99.252% ( 580, 870 ] 1785 0.263% 99.515% ( 870, 1300 ] 1611 0.237% 99.753% ( 1300, 1900 ] 976 0.144% 99.897% ( 1900, 2900 ] 725 0.107% 100.004% ( 2900, 4400 ] 682 0.101% 100.104% ( 4400, 6600 ] 168 0.025% 100.129% ( 6600, 9900 ] 32 0.005% 100.134% ( 9900, 14000 ] 3 0.000% 100.134% ( 22000, 33000 ] 1 0.000% 100.134% ( 33000, 50000 ] 1 0.000% 100.134% ** Level 5 read latency histogram (micros): Count: 52394 Average: 639.5152 StdDev: 1262.50 Min: 75 Median: 240.3243 Max: 90102 Percentiles: P50: 240.32 P75: 626.40 P99: 5393.22 P99.9: 9217.79 P99.99: 29040.73 ------------------------------------------------------ ( 51, 76 ] 2 0.004% 0.004% ( 76, 110 ] 3964 7.566% 7.570% ## ( 110, 170 ] 14534 27.740% 35.309% ###### ( 170, 250 ] 8756 16.712% 52.021% ### ( 250, 380 ] 5568 10.627% 62.648% ## ( 380, 580 ] 5761 10.996% 73.644% ## ( 580, 870 ] 4441 8.476% 82.120% ## ( 870, 1300 ] 3293 6.285% 88.405% # ( 1300, 1900 ] 1970 3.760% 92.165% # ( 1900, 2900 ] 1601 3.056% 95.221% # ( 2900, 4400 ] 1669 3.185% 98.406% # ( 4400, 6600 ] 689 1.315% 99.721% ( 6600, 9900 ] 118 0.225% 99.947% ( 9900, 14000 ] 9 0.017% 99.964% ( 14000, 22000 ] 8 0.015% 99.979% ( 22000, 33000 ] 9 0.017% 99.996% ( 33000, 50000 ] 3 0.006% 100.002% ( 50000, 75000 ] 2 0.004% 100.006% ( 75000, 110000 ] 2 0.004% 100.010% ** DB Stats ** Uptime(secs): 11.8 total, 3.6 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 166.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.937 H:M:S, 33.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 275.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/13-16:28:30 ... thread 0: (1000000,3000000) ops and (286112.1,197992.1) ops/second in (3.495134,15.152117) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.83 GB 264.3 2.5 0.0 2.5 5.3 2.8 0.0 1.9 99.8 214.4 25.26 17.47 51 0.495 2558K 2763 0.0 0.0 L1 21/0 1.76 GB 180.5 1.8 1.0 0.8 1.8 1.0 0.0 1.8 126.0 125.3 14.40 8.95 1 14.403 1842K 8752 0.0 0.0 L2 1/0 82.35 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 955.43 MB 1.0 1.0 0.5 0.5 1.0 0.5 0.1 2.1 94.5 93.3 10.95 4.99 5 2.189 766K 6208 0.0 0.0 L4 158/0 9.56 GB 1.0 6.2 3.4 2.8 6.1 3.3 0.0 1.8 111.3 109.4 56.87 29.40 30 1.896 1640K 0 0.0 0.0 L5 1132/0 93.26 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1345/4 108.43 GB 0.0 11.4 4.9 6.6 14.1 7.6 3.4 5.0 108.8 134.6 107.47 60.82 87 1.235 6808K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.4 4.9 6.6 14.1 7.6 3.4 5.0 108.8 134.6 107.47 60.82 87 1.235 6808K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.4 4.9 6.6 11.3 4.7 0.0 0.0 125.0 123.6 93.56 52.93 45 2.079 6808K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 208.2 13.92 7.89 42 0.331 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.3 total, 15.2 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.13 GB write, 944.49 MB/s write, 11.42 GB read, 763.69 MB/s read, 107.5 seconds Interval compaction: 14.13 GB write, 954.53 MB/s write, 11.42 GB read, 771.81 MB/s read, 107.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 24, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 944856 Average: 9.4536 StdDev: 123.61 Min: 0 Median: 1.6678 Max: 34976 Percentiles: P50: 1.67 P75: 2.39 P99: 157.43 P99.9: 1050.45 P99.99: 2593.11 ------------------------------------------------------ [ 0, 1 ] 120235 12.725% 12.725% ### ( 1, 2 ] 527383 55.816% 68.541% ########### ( 2, 3 ] 158113 16.734% 85.276% ### ( 3, 4 ] 56224 5.951% 91.226% # ( 4, 6 ] 53130 5.623% 96.849% # ( 6, 10 ] 12178 1.289% 98.138% ( 10, 15 ] 2381 0.252% 98.390% ( 15, 22 ] 315 0.033% 98.423% ( 22, 34 ] 41 0.004% 98.428% ( 34, 51 ] 28 0.003% 98.431% ( 51, 76 ] 27 0.003% 98.434% ( 76, 110 ] 1354 0.143% 98.577% ( 110, 170 ] 5059 0.535% 99.112% ( 170, 250 ] 3062 0.324% 99.436% ( 250, 380 ] 1661 0.176% 99.612% ( 380, 580 ] 1565 0.166% 99.778% ( 580, 870 ] 914 0.097% 99.874% ( 870, 1300 ] 577 0.061% 99.936% ( 1300, 1900 ] 336 0.036% 99.971% ( 1900, 2900 ] 259 0.027% 99.999% ( 2900, 4400 ] 254 0.027% 100.025% ( 4400, 6600 ] 68 0.007% 100.033% ( 6600, 9900 ] 16 0.002% 100.034% ( 9900, 14000 ] 1 0.000% 100.034% ( 14000, 22000 ] 2 0.000% 100.035% ( 22000, 33000 ] 4 0.000% 100.035% ( 33000, 50000 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 200019 Average: 6.5829 StdDev: 80.19 Min: 1 Median: 1.9184 Max: 8070 Percentiles: P50: 1.92 P75: 2.91 P99: 15.11 P99.9: 856.14 P99.99: 3880.66 ------------------------------------------------------ [ 0, 1 ] 8386 4.193% 4.193% # ( 1, 2 ] 99760 49.875% 54.068% ########## ( 2, 3 ] 46208 23.102% 77.170% ##### ( 3, 4 ] 18602 9.300% 86.470% ## ( 4, 6 ] 18233 9.116% 95.585% ## ( 6, 10 ] 5915 2.957% 98.543% # ( 10, 15 ] 909 0.454% 98.997% ( 15, 22 ] 354 0.177% 99.174% ( 22, 34 ] 30 0.015% 99.189% ( 34, 51 ] 2 0.001% 99.190% ( 51, 76 ] 1 0.000% 99.191% ( 76, 110 ] 198 0.099% 99.290% ( 110, 170 ] 550 0.275% 99.565% ( 170, 250 ] 287 0.143% 99.708% ( 250, 380 ] 145 0.072% 99.781% ( 380, 580 ] 139 0.069% 99.850% ( 580, 870 ] 105 0.052% 99.903% ( 870, 1300 ] 83 0.041% 99.944% ( 1300, 1900 ] 38 0.019% 99.963% ( 1900, 2900 ] 37 0.018% 99.982% ( 2900, 4400 ] 26 0.013% 99.995% ( 4400, 6600 ] 9 0.004% 99.999% ( 6600, 9900 ] 3 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 126485 Average: 11.1574 StdDev: 202.29 Min: 1 Median: 1.9940 Max: 27131 Percentiles: P50: 1.99 P75: 3.11 P99: 13.41 P99.9: 1547.53 P99.99: 3014.26 ------------------------------------------------------ [ 0, 1 ] 4046 3.199% 3.199% # ( 1, 2 ] 59553 47.083% 50.282% ######### ( 2, 3 ] 29840 23.592% 73.874% ##### ( 3, 4 ] 13341 10.547% 84.421% ## ( 4, 6 ] 13683 10.818% 95.239% ## ( 6, 10 ] 4190 3.313% 98.552% # ( 10, 15 ] 832 0.658% 99.209% ( 15, 22 ] 123 0.097% 99.307% ( 22, 34 ] 33 0.026% 99.333% ( 34, 51 ] 14 0.011% 99.344% ( 51, 76 ] 9 0.007% 99.351% ( 76, 110 ] 34 0.027% 99.378% ( 110, 170 ] 114 0.090% 99.468% ( 170, 250 ] 100 0.079% 99.547% ( 250, 380 ] 89 0.070% 99.617% ( 380, 580 ] 135 0.107% 99.724% ( 580, 870 ] 116 0.092% 99.816% ( 870, 1300 ] 83 0.066% 99.881% ( 1300, 1900 ] 57 0.045% 99.926% ( 1900, 2900 ] 77 0.061% 99.987% ( 2900, 4400 ] 44 0.035% 100.022% ( 4400, 6600 ] 17 0.013% 100.036% ( 6600, 9900 ] 10 0.008% 100.043% ( 9900, 14000 ] 2 0.002% 100.045% ( 14000, 22000 ] 1 0.001% 100.046% ( 22000, 33000 ] 4 0.003% 100.049% ** Level 3 read latency histogram (micros): Count: 745252 Average: 10.3765 StdDev: 162.52 Min: 1 Median: 1.9753 Max: 33731 Percentiles: P50: 1.98 P75: 2.98 P99: 9.84 P99.9: 823.40 P99.99: 1331.05 ------------------------------------------------------ [ 0, 1 ] 14087 1.890% 1.890% ( 1, 2 ] 367634 49.330% 51.220% ########## ( 2, 3 ] 181520 24.357% 75.577% ##### ( 3, 4 ] 75474 10.127% 85.705% ## ( 4, 6 ] 80325 10.778% 96.483% ## ( 6, 10 ] 19519 2.619% 99.102% # ( 10, 15 ] 3295 0.442% 99.544% ( 15, 22 ] 405 0.054% 99.598% ( 22, 34 ] 41 0.006% 99.604% ( 34, 51 ] 50 0.007% 99.611% ( 51, 76 ] 49 0.007% 99.617% ( 76, 110 ] 192 0.026% 99.643% ( 110, 170 ] 510 0.068% 99.711% ( 170, 250 ] 311 0.042% 99.753% ( 250, 380 ] 258 0.035% 99.788% ( 380, 580 ] 381 0.051% 99.839% ( 580, 870 ] 543 0.073% 99.912% ( 870, 1300 ] 562 0.075% 99.987% ( 1300, 1900 ] 415 0.056% 100.043% ( 1900, 2900 ] 376 0.050% 100.093% ( 2900, 4400 ] 443 0.059% 100.153% ( 4400, 6600 ] 105 0.014% 100.167% ( 6600, 9900 ] 32 0.004% 100.171% ( 9900, 14000 ] 3 0.000% 100.171% ( 14000, 22000 ] 3 0.000% 100.172% ( 22000, 33000 ] 4 0.001% 100.172% ( 33000, 50000 ] 1 0.000% 100.173% ** Level 4 read latency histogram (micros): Count: 685128 Average: 21.6402 StdDev: 200.68 Min: 0 Median: 1.9988 Max: 43213 Percentiles: P50: 2.00 P75: 3.07 P99: 421.02 P99.9: 1928.55 P99.99: 2772.08 ------------------------------------------------------ [ 0, 1 ] 12555 1.833% 1.833% ( 1, 2 ] 330410 48.226% 50.059% ########## ( 2, 3 ] 165878 24.211% 74.270% ##### ( 3, 4 ] 67672 9.877% 84.147% ## ( 4, 6 ] 69211 10.102% 94.249% ## ( 6, 10 ] 17745 2.590% 96.839% # ( 10, 15 ] 2976 0.434% 97.273% ( 15, 22 ] 376 0.055% 97.328% ( 22, 34 ] 30 0.004% 97.333% ( 34, 51 ] 49 0.007% 97.340% ( 51, 76 ] 50 0.007% 97.347% ( 76, 110 ] 1514 0.221% 97.568% ( 110, 170 ] 4917 0.718% 98.286% ( 170, 250 ] 2695 0.393% 98.679% ( 250, 380 ] 1799 0.263% 98.942% ( 380, 580 ] 1949 0.284% 99.226% ( 580, 870 ] 1969 0.287% 99.514% ( 870, 1300 ] 1645 0.240% 99.754% ( 1300, 1900 ] 982 0.143% 99.897% ( 1900, 2900 ] 731 0.107% 100.004% ( 2900, 4400 ] 683 0.100% 100.103% ( 4400, 6600 ] 168 0.025% 100.128% ( 6600, 9900 ] 32 0.005% 100.133% ( 9900, 14000 ] 3 0.000% 100.133% ( 22000, 33000 ] 1 0.000% 100.133% ( 33000, 50000 ] 1 0.000% 100.133% ** Level 5 read latency histogram (micros): Count: 95424 Average: 448.4806 StdDev: 965.15 Min: 73 Median: 191.1403 Max: 90102 Percentiles: P50: 191.14 P75: 399.55 P99: 4285.92 P99.9: 7790.68 P99.99: 15457.60 ------------------------------------------------------ ( 51, 76 ] 8 0.008% 0.008% ( 76, 110 ] 9736 10.203% 10.211% ## ( 110, 170 ] 33287 34.883% 45.095% ####### ( 170, 250 ] 17714 18.563% 63.658% #### ( 250, 380 ] 9914 10.389% 74.047% ## ( 380, 580 ] 9300 9.746% 83.793% ## ( 580, 870 ] 5787 6.065% 89.858% # ( 870, 1300 ] 3556 3.727% 93.584% # ( 1300, 1900 ] 2001 2.097% 95.681% ( 1900, 2900 ] 1621 1.699% 97.380% ( 2900, 4400 ] 1673 1.753% 99.133% ( 4400, 6600 ] 689 0.722% 99.855% ( 6600, 9900 ] 118 0.124% 99.979% ( 9900, 14000 ] 9 0.009% 99.988% ( 14000, 22000 ] 8 0.008% 99.997% ( 22000, 33000 ] 9 0.009% 100.006% ( 33000, 50000 ] 3 0.003% 100.009% ( 50000, 75000 ] 2 0.002% 100.012% ( 75000, 110000 ] 2 0.002% 100.014% ** DB Stats ** Uptime(secs): 15.3 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 192.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.937 H:M:S, 25.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 281.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 210.959 micros/op 18927 ops/sec 60.175 seconds 1138996 operations; 18.3 MB/s (293999 of 293999 found) Microseconds per read: Count: 1138996 Average: 210.9606 StdDev: 677.46 Min: 2 Median: 160.4015 Max: 163264 Percentiles: P50: 160.40 P75: 216.05 P99: 830.17 P99.9: 8405.72 P99.99: 26577.16 ------------------------------------------------------ ( 1, 2 ] 24 0.002% 0.002% ( 2, 3 ] 64 0.006% 0.008% ( 3, 4 ] 72 0.006% 0.014% ( 4, 6 ] 101 0.009% 0.023% ( 6, 10 ] 562 0.049% 0.072% ( 10, 15 ] 5979 0.525% 0.597% ( 15, 22 ] 5752 0.505% 1.102% ( 22, 34 ] 9233 0.811% 1.913% ( 34, 51 ] 2433 0.214% 2.126% ( 51, 76 ] 281 0.025% 2.151% ( 76, 110 ] 41118 3.610% 5.761% # ( 110, 170 ] 599838 52.664% 58.425% ########### ( 170, 250 ] 328004 28.798% 87.223% ###### ( 250, 380 ] 94412 8.289% 95.512% ## ( 380, 580 ] 30550 2.682% 98.194% # ( 580, 870 ] 10645 0.935% 99.128% ( 870, 1300 ] 4361 0.383% 99.511% ( 1300, 1900 ] 1765 0.155% 99.666% ( 1900, 2900 ] 1240 0.109% 99.775% ( 2900, 4400 ] 1001 0.088% 99.863% ( 4400, 6600 ] 306 0.027% 99.890% ( 6600, 9900 ] 212 0.019% 99.908% ( 9900, 14000 ] 429 0.038% 99.946% ( 14000, 22000 ] 451 0.040% 99.986% ( 22000, 33000 ] 118 0.010% 99.996% ( 33000, 50000 ] 31 0.003% 99.999% ( 50000, 75000 ] 6 0.001% 99.999% ( 75000, 110000 ] 4 0.000% 100.000% ( 110000, 170000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 18680509 rocksdb.bloom.filter.full.positive COUNT : 1321021 rocksdb.bloom.filter.full.true.positive COUNT : 1138565 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 431 rocksdb.memtable.miss COUNT : 1138565 rocksdb.l0.hit COUNT : 38311 rocksdb.l1.hit COUNT : 19138 rocksdb.l2andup.hit COUNT : 1081116 rocksdb.compaction.key.drop.new COUNT : 172681 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3607247 rocksdb.number.keys.read COUNT : 1138996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3722678904 rocksdb.bytes.read COUNT : 1138996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1527 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 45904404 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 15195402504 rocksdb.compact.write.bytes COUNT : 15020058365 rocksdb.flush.write.bytes COUNT : 3699308190 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 27 rocksdb.number.superversion_acquires COUNT : 675 rocksdb.number.superversion_releases COUNT : 647 rocksdb.number.superversion_cleanups COUNT : 168 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 181 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3669406720 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1364992 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 20009603710 rocksdb.non.last.level.read.count COUNT : 4692355 rocksdb.block.checksum.compute.count COUNT : 5015079 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 159.746802 P95 : 371.546198 P99 : 829.447581 P100 : 163262.000000 COUNT : 1138996 SUM : 239422173 rocksdb.db.write.micros P50 : 1.589757 P95 : 4.756232 P99 : 13.593353 P100 : 988738.000000 COUNT : 3607247 SUM : 55324521 rocksdb.compaction.times.micros P50 : 1941666.666667 P95 : 2841666.666667 P99 : 14402855.000000 P100 : 14402855.000000 COUNT : 48 SUM : 96428239 rocksdb.compaction.times.cpu_micros P50 : 1018666.666667 P95 : 1760000.000000 P99 : 8216000.000000 P100 : 8951691.000000 COUNT : 48 SUM : 55709027 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 781.739130 P95 : 152000.000000 P99 : 298023.000000 P100 : 298023.000000 COUNT : 52 SUM : 893492 rocksdb.compaction.outfile.sync.micros P50 : 46076.923077 P95 : 330600.000000 P99 : 533900.000000 P100 : 829160.000000 COUNT : 176 SUM : 15276317 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 214.000000 P95 : 3781.250000 P99 : 6504.666667 P100 : 8274.000000 COUNT : 113 SUM : 100554 rocksdb.table.open.io.micros P50 : 8834.449244 P95 : 20329.292929 P99 : 30681.200000 P100 : 151240.000000 COUNT : 1527 SUM : 14838351 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.418771 P95 : 77.388198 P99 : 187.261796 P100 : 49040.000000 COUNT : 3680820 SUM : 64420449 rocksdb.read.block.get.micros P50 : 133.712445 P95 : 247.088640 P99 : 779.755069 P100 : 90166.000000 COUNT : 1332754 SUM : 204204302 rocksdb.write.raw.block.micros P50 : 0.563606 P95 : 1.687635 P99 : 4.001788 P100 : 98786.000000 COUNT : 4534084 SUM : 14407423 rocksdb.numfiles.in.singlecompaction P50 : 3.296875 P95 : 5.980000 P99 : 26.680000 P100 : 34.000000 COUNT : 61 SUM : 257 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.599550 P95 : 2299.142555 P99 : 2780.312004 P100 : 988552.000000 COUNT : 159231 SUM : 45919804 rocksdb.sst.read.micros P50 : 2.863978 P95 : 167.766942 P99 : 420.309099 P100 : 90102.000000 COUNT : 4692426 SUM : 252196159 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1138996 SUM : 1138996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3607247 SUM : 3722678904 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 222000.000000 P95 : 1018666.666667 P99 : 1228790.000000 P100 : 1228790.000000 COUNT : 52 SUM : 15940445 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 190 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0