[2024-07-15 16:04:28.513894] Starting SPDK v24.09-pre git sha1 255871c19 / DPDK 24.03.0 initialization... [2024-07-15 16:04:28.514239] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3444826 ] Set seed to 1721052268506454 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 16:04:28.671770] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 16:04:28.897507] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 16:04:28.897555] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3444826' to capture a snapshot of events at runtime. [2024-07-15 16:04:28.897568] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 16:04:28.897581] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 16:04:28.897591] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3444826 for offline analysis/debug. [2024-07-15 16:04:28.897689] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 16:04:32 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/15-16:04:39 ... thread 0: (1000000,1000000) ops and (147381.2,147381.2) ops/second in (6.785128,6.785128) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 817.17 MB 18.8 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 138.4 5.90 2.47 10 0.590 0 0 0.0 0.0 L1 3/3 125.01 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 104.1 103.6 2.22 1.18 1 2.218 234K 997 0.0 0.0 L2 2/0 104.88 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 93.3 93.3 1.12 0.56 1 1.124 106K 0 0.0 0.0 L3 37/8 2.10 GB 1.5 3.1 1.9 1.2 3.0 1.8 0.0 1.5 108.5 103.1 29.47 16.24 13 2.267 2300K 11K 0.0 0.0 L4 168/26 11.75 GB 1.0 2.6 1.5 1.1 2.5 1.3 0.6 1.7 120.3 113.4 22.38 13.46 13 1.722 496K 0 0.0 0.0 L5 116/0 9.10 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 336/45 23.98 GB 0.0 6.1 3.7 2.3 6.6 4.2 0.6 8.2 101.9 110.1 61.10 33.91 38 1.608 3137K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 3.7 2.3 6.6 4.2 0.6 8.2 101.9 110.1 61.10 33.91 38 1.608 3137K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 3.7 2.3 5.8 3.4 0.0 0.0 112.8 107.1 55.20 31.44 28 1.971 3137K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 138.4 5.90 2.47 10 0.590 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.9 total, 6.8 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.57 GB write, 978.37 MB/s write, 6.08 GB read, 905.43 MB/s read, 61.1 seconds Interval compaction: 6.57 GB write, 991.08 MB/s write, 6.08 GB read, 917.20 MB/s read, 61.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 65053 Average: 96.9690 StdDev: 871.19 Min: 1 Median: 2.3663 Max: 75996 Percentiles: P50: 2.37 P75: 3.77 P99: 1882.35 P99.9: 6294.54 P99.99: 40426.24 ------------------------------------------------------ [ 0, 1 ] 998 1.534% 1.534% ( 1, 2 ] 24960 38.369% 39.903% ######## ( 2, 3 ] 17934 27.568% 67.471% ###### ( 3, 4 ] 6321 9.717% 77.188% ## ( 4, 6 ] 7242 11.132% 88.320% ## ( 6, 10 ] 1869 2.873% 91.193% # ( 10, 15 ] 444 0.683% 91.876% ( 15, 22 ] 63 0.097% 91.973% ( 22, 34 ] 9 0.014% 91.987% ( 51, 76 ] 1 0.002% 91.988% ( 76, 110 ] 3 0.005% 91.993% ( 110, 170 ] 40 0.061% 92.054% ( 170, 250 ] 191 0.294% 92.348% ( 250, 380 ] 611 0.939% 93.287% ( 380, 580 ] 1350 2.075% 95.362% ( 580, 870 ] 1489 2.289% 97.651% ( 870, 1300 ] 662 1.018% 98.669% ( 1300, 1900 ] 222 0.341% 99.010% ( 1900, 2900 ] 213 0.327% 99.337% ( 2900, 4400 ] 316 0.486% 99.823% ( 4400, 6600 ] 58 0.089% 99.912% ( 6600, 9900 ] 20 0.031% 99.943% ( 9900, 14000 ] 7 0.011% 99.954% ( 14000, 22000 ] 5 0.008% 99.962% ( 22000, 33000 ] 15 0.023% 99.985% ( 33000, 50000 ] 8 0.012% 99.997% ( 50000, 75000 ] 1 0.002% 99.998% ( 75000, 110000 ] 1 0.002% 100.000% ** Level 1 read latency histogram (micros): Count: 26914 Average: 23.1890 StdDev: 417.39 Min: 1 Median: 2.3379 Max: 39538 Percentiles: P50: 2.34 P75: 3.26 P99: 438.65 P99.9: 3793.67 P99.99: 19234.40 ------------------------------------------------------ [ 0, 1 ] 183 0.680% 0.680% ( 1, 2 ] 10223 37.984% 38.664% ######## ( 2, 3 ] 9029 33.548% 72.211% ####### ( 3, 4 ] 2903 10.786% 82.998% ## ( 4, 6 ] 3281 12.191% 95.188% ## ( 6, 10 ] 782 2.906% 98.094% # ( 10, 15 ] 157 0.583% 98.677% ( 15, 22 ] 12 0.045% 98.722% ( 34, 51 ] 3 0.011% 98.733% ( 110, 170 ] 2 0.007% 98.740% ( 170, 250 ] 10 0.037% 98.778% ( 250, 380 ] 32 0.119% 98.896% ( 380, 580 ] 95 0.353% 99.249% ( 580, 870 ] 84 0.312% 99.562% ( 870, 1300 ] 45 0.167% 99.729% ( 1300, 1900 ] 9 0.033% 99.762% ( 1900, 2900 ] 21 0.078% 99.840% ( 2900, 4400 ] 27 0.100% 99.941% ( 4400, 6600 ] 6 0.022% 99.963% ( 6600, 9900 ] 4 0.015% 99.978% ( 9900, 14000 ] 2 0.007% 99.985% ( 14000, 22000 ] 2 0.007% 99.993% ( 22000, 33000 ] 2 0.007% 100.000% ( 33000, 50000 ] 1 0.004% 100.004% ** Level 2 read latency histogram (micros): Count: 433937 Average: 15.3197 StdDev: 262.44 Min: 1 Median: 2.3890 Max: 39436 Percentiles: P50: 2.39 P75: 3.42 P99: 13.34 P99.9: 1256.12 P99.99: 2267.08 ------------------------------------------------------ [ 0, 1 ] 3129 0.721% 0.721% ( 1, 2 ] 157973 36.405% 37.126% ####### ( 2, 3 ] 143632 33.100% 70.225% ####### ( 3, 4 ] 49234 11.346% 81.571% ## ( 4, 6 ] 58795 13.549% 95.120% ### ( 6, 10 ] 14432 3.326% 98.446% # ( 10, 15 ] 3595 0.828% 99.275% ( 15, 22 ] 566 0.130% 99.405% ( 22, 34 ] 76 0.018% 99.423% ( 34, 51 ] 126 0.029% 99.452% ( 51, 76 ] 85 0.020% 99.471% ( 76, 110 ] 27 0.006% 99.478% ( 110, 170 ] 37 0.009% 99.486% ( 170, 250 ] 73 0.017% 99.503% ( 250, 380 ] 298 0.069% 99.572% ( 380, 580 ] 605 0.139% 99.711% ( 580, 870 ] 539 0.124% 99.835% ( 870, 1300 ] 313 0.072% 99.907% ( 1300, 1900 ] 236 0.054% 99.962% ( 1900, 2900 ] 334 0.077% 100.039% ( 2900, 4400 ] 327 0.075% 100.114% ( 4400, 6600 ] 120 0.028% 100.142% ( 6600, 9900 ] 57 0.013% 100.155% ( 9900, 14000 ] 15 0.003% 100.158% ( 14000, 22000 ] 13 0.003% 100.161% ( 22000, 33000 ] 10 0.002% 100.164% ( 33000, 50000 ] 2 0.000% 100.164% ** Level 3 read latency histogram (micros): Count: 680027 Average: 18.4245 StdDev: 330.03 Min: 1 Median: 2.4246 Max: 52304 Percentiles: P50: 2.42 P75: 3.42 P99: 14.47 P99.9: 1099.08 P99.99: 1715.38 ------------------------------------------------------ [ 0, 1 ] 4278 0.629% 0.629% ( 1, 2 ] 234816 34.530% 35.159% ####### ( 2, 3 ] 237682 34.952% 70.111% ####### ( 3, 4 ] 78451 11.536% 81.648% ## ( 4, 6 ] 91658 13.479% 95.126% ### ( 6, 10 ] 22004 3.236% 98.362% # ( 10, 15 ] 4850 0.713% 99.075% ( 15, 22 ] 516 0.076% 99.151% ( 22, 34 ] 105 0.015% 99.167% ( 34, 51 ] 233 0.034% 99.201% ( 51, 76 ] 157 0.023% 99.224% ( 76, 110 ] 48 0.007% 99.231% ( 110, 170 ] 88 0.013% 99.244% ( 170, 250 ] 262 0.039% 99.283% ( 250, 380 ] 739 0.109% 99.391% ( 380, 580 ] 1534 0.226% 99.617% ( 580, 870 ] 1536 0.226% 99.843% ( 870, 1300 ] 732 0.108% 99.950% ( 1300, 1900 ] 390 0.057% 100.008% ( 1900, 2900 ] 476 0.070% 100.078% ( 2900, 4400 ] 620 0.091% 100.169% ( 4400, 6600 ] 157 0.023% 100.192% ( 6600, 9900 ] 64 0.009% 100.201% ( 9900, 14000 ] 29 0.004% 100.206% ( 14000, 22000 ] 46 0.007% 100.212% ( 22000, 33000 ] 22 0.003% 100.216% ( 33000, 50000 ] 11 0.002% 100.217% ( 50000, 75000 ] 1 0.000% 100.217% ** Level 4 read latency histogram (micros): Count: 410644 Average: 39.9390 StdDev: 533.56 Min: 1 Median: 2.4456 Max: 62878 Percentiles: P50: 2.45 P75: 3.54 P99: 731.78 P99.9: 2764.38 P99.99: 3450.20 ------------------------------------------------------ [ 0, 1 ] 2772 0.675% 0.675% ( 1, 2 ] 140165 34.133% 34.808% ####### ( 2, 3 ] 139992 34.091% 68.899% ####### ( 3, 4 ] 46525 11.330% 80.229% ## ( 4, 6 ] 54478 13.266% 93.495% ### ( 6, 10 ] 12992 3.164% 96.659% # ( 10, 15 ] 2854 0.695% 97.354% ( 15, 22 ] 316 0.077% 97.431% ( 22, 34 ] 58 0.014% 97.445% ( 34, 51 ] 108 0.026% 97.471% ( 51, 76 ] 100 0.024% 97.496% ( 76, 110 ] 26 0.006% 97.502% ( 110, 170 ] 90 0.022% 97.524% ( 170, 250 ] 417 0.102% 97.625% ( 250, 380 ] 1339 0.326% 97.952% ( 380, 580 ] 2850 0.694% 98.646% ( 580, 870 ] 2781 0.677% 99.323% ( 870, 1300 ] 1276 0.311% 99.634% ( 1300, 1900 ] 574 0.140% 99.773% ( 1900, 2900 ] 602 0.147% 99.920% ( 2900, 4400 ] 785 0.191% 100.111% ( 4400, 6600 ] 216 0.053% 100.164% ( 6600, 9900 ] 62 0.015% 100.179% ( 9900, 14000 ] 27 0.007% 100.185% ( 14000, 22000 ] 52 0.013% 100.198% ( 22000, 33000 ] 42 0.010% 100.208% ( 33000, 50000 ] 19 0.005% 100.213% ( 50000, 75000 ] 3 0.001% 100.214% ** Level 5 read latency histogram (micros): Count: 7866 Average: 1170.9893 StdDev: 2495.68 Min: 108 Median: 650.4621 Max: 54996 Percentiles: P50: 650.46 P75: 1056.80 P99: 6531.76 P99.9: 43909.75 P99.99: 54996.00 ------------------------------------------------------ ( 76, 110 ] 2 0.025% 0.025% ( 110, 170 ] 53 0.674% 0.699% ( 170, 250 ] 282 3.585% 4.284% # ( 250, 380 ] 984 12.510% 16.794% ### ( 380, 580 ] 2102 26.723% 43.516% ##### ( 580, 870 ] 2099 26.684% 70.201% ##### ( 870, 1300 ] 869 11.048% 81.248% ## ( 1300, 1900 ] 373 4.742% 85.990% # ( 1900, 2900 ] 408 5.187% 91.177% # ( 2900, 4400 ] 501 6.369% 97.546% # ( 4400, 6600 ] 118 1.500% 99.047% ( 6600, 9900 ] 26 0.331% 99.377% ( 9900, 14000 ] 9 0.114% 99.491% ( 14000, 22000 ] 12 0.153% 99.644% ( 22000, 33000 ] 15 0.191% 99.835% ( 33000, 50000 ] 8 0.102% 99.936% ( 50000, 75000 ] 5 0.064% 100.000% ** DB Stats ** Uptime(secs): 6.9 total, 6.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 143.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.778 H:M:S, 25.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 144.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.778 H:M:S, 26.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/15-16:04:45 ... thread 0: (1000000,2000000) ops and (157759.5,152393.8) ops/second in (6.338763,13.123891) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.53 GB 131.4 0.9 0.0 0.9 2.8 1.8 0.0 1.5 41.7 124.9 22.61 10.50 27 0.837 957K 5590 0.0 0.0 L1 8/0 435.59 MB 43.6 0.7 0.5 0.1 0.6 0.5 0.0 1.2 56.6 56.2 11.84 3.80 2 5.918 680K 4749 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 93.3 93.3 1.12 0.56 1 1.124 106K 0 0.0 0.0 L3 19/0 947.20 MB 0.9 3.1 1.9 1.2 3.0 1.8 0.1 1.5 108.5 103.1 29.47 16.24 13 2.267 2300K 11K 0.0 0.0 L4 153/0 9.64 GB 1.0 8.8 2.8 6.0 7.7 1.6 0.6 2.8 130.0 113.3 69.45 42.33 33 2.105 1745K 0 0.0 0.0 L5 152/0 11.51 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 343/4 24.03 GB 0.0 13.6 5.3 8.3 14.2 5.9 3.2 7.7 103.7 107.8 134.49 73.43 76 1.770 5790K 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.6 5.3 8.3 14.2 5.9 3.2 7.7 103.7 107.8 134.49 73.43 76 1.770 5790K 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.6 5.3 8.3 12.3 4.0 0.0 0.0 114.4 103.5 121.89 67.60 52 2.344 5790K 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 149.7 12.60 5.83 24 0.525 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.2 total, 13.1 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.16 GB write, 1097.21 MB/s write, 13.62 GB read, 1055.30 MB/s read, 134.5 seconds Interval compaction: 14.16 GB write, 1104.58 MB/s write, 13.62 GB read, 1062.39 MB/s read, 134.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 34, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 413060 Average: 45.9343 StdDev: 514.43 Min: 1 Median: 2.3109 Max: 75996 Percentiles: P50: 2.31 P75: 3.42 P99: 881.04 P99.9: 4011.43 P99.99: 5627.87 ------------------------------------------------------ [ 0, 1 ] 7915 1.916% 1.916% ( 1, 2 ] 159894 38.710% 40.626% ######## ( 2, 3 ] 124541 30.151% 70.777% ###### ( 3, 4 ] 41955 10.157% 80.934% ## ( 4, 6 ] 46937 11.363% 92.297% ## ( 6, 10 ] 12395 3.001% 95.298% # ( 10, 15 ] 2512 0.608% 95.906% ( 15, 22 ] 325 0.079% 95.985% ( 22, 34 ] 33 0.008% 95.993% ( 34, 51 ] 53 0.013% 96.005% ( 51, 76 ] 53 0.013% 96.018% ( 76, 110 ] 24 0.006% 96.024% ( 110, 170 ] 330 0.080% 96.104% ( 170, 250 ] 1352 0.327% 96.431% ( 250, 380 ] 2312 0.560% 96.991% ( 380, 580 ] 4105 0.994% 97.985% ( 580, 870 ] 4148 1.004% 98.989% ( 870, 1300 ] 1846 0.447% 99.436% ( 1300, 1900 ] 578 0.140% 99.576% ( 1900, 2900 ] 640 0.155% 99.731% ( 2900, 4400 ] 946 0.229% 99.960% ( 4400, 6600 ] 227 0.055% 100.015% ( 6600, 9900 ] 60 0.015% 100.029% ( 9900, 14000 ] 17 0.004% 100.033% ( 14000, 22000 ] 20 0.005% 100.038% ( 22000, 33000 ] 36 0.009% 100.047% ( 33000, 50000 ] 18 0.004% 100.051% ( 50000, 75000 ] 1 0.000% 100.052% ( 75000, 110000 ] 1 0.000% 100.052% ** Level 1 read latency histogram (micros): Count: 59072 Average: 20.0784 StdDev: 308.83 Min: 1 Median: 2.3568 Max: 39538 Percentiles: P50: 2.36 P75: 3.35 P99: 420.81 P99.9: 3452.00 P99.99: 9301.25 ------------------------------------------------------ [ 0, 1 ] 486 0.823% 0.823% ( 1, 2 ] 22058 37.341% 38.164% ####### ( 2, 3 ] 19599 33.178% 71.342% ####### ( 3, 4 ] 6220 10.530% 81.871% ## ( 4, 6 ] 7380 12.493% 94.365% ## ( 6, 10 ] 1978 3.348% 97.713% # ( 10, 15 ] 375 0.635% 98.348% ( 15, 22 ] 55 0.093% 98.441% ( 22, 34 ] 6 0.010% 98.451% ( 34, 51 ] 8 0.014% 98.465% ( 51, 76 ] 7 0.012% 98.476% ( 76, 110 ] 5 0.008% 98.485% ( 110, 170 ] 24 0.041% 98.526% ( 170, 250 ] 108 0.183% 98.708% ( 250, 380 ] 128 0.217% 98.925% ( 380, 580 ] 217 0.367% 99.292% ( 580, 870 ] 183 0.310% 99.602% ( 870, 1300 ] 83 0.141% 99.743% ( 1300, 1900 ] 29 0.049% 99.792% ( 1900, 2900 ] 47 0.080% 99.871% ( 2900, 4400 ] 46 0.078% 99.949% ( 4400, 6600 ] 20 0.034% 99.983% ( 6600, 9900 ] 5 0.008% 99.992% ( 9900, 14000 ] 2 0.003% 99.995% ( 14000, 22000 ] 2 0.003% 99.998% ( 22000, 33000 ] 2 0.003% 100.002% ( 33000, 50000 ] 1 0.002% 100.003% ** Level 2 read latency histogram (micros): Count: 434186 Average: 15.7965 StdDev: 264.58 Min: 1 Median: 2.3898 Max: 39436 Percentiles: P50: 2.39 P75: 3.42 P99: 13.68 P99.9: 1304.44 P99.99: 2335.34 ------------------------------------------------------ [ 0, 1 ] 3129 0.721% 0.721% ( 1, 2 ] 157973 36.384% 37.104% ####### ( 2, 3 ] 143632 33.081% 70.185% ####### ( 3, 4 ] 49234 11.339% 81.525% ## ( 4, 6 ] 58795 13.541% 95.066% ### ( 6, 10 ] 14432 3.324% 98.390% # ( 10, 15 ] 3595 0.828% 99.218% ( 15, 22 ] 566 0.130% 99.348% ( 22, 34 ] 76 0.018% 99.366% ( 34, 51 ] 126 0.029% 99.395% ( 51, 76 ] 85 0.020% 99.414% ( 76, 110 ] 28 0.006% 99.421% ( 110, 170 ] 45 0.010% 99.431% ( 170, 250 ] 116 0.027% 99.458% ( 250, 380 ] 343 0.079% 99.537% ( 380, 580 ] 658 0.152% 99.688% ( 580, 870 ] 587 0.135% 99.824% ( 870, 1300 ] 330 0.076% 99.900% ( 1300, 1900 ] 245 0.056% 99.956% ( 1900, 2900 ] 339 0.078% 100.034% ( 2900, 4400 ] 341 0.079% 100.113% ( 4400, 6600 ] 124 0.029% 100.141% ( 6600, 9900 ] 59 0.014% 100.155% ( 9900, 14000 ] 15 0.003% 100.158% ( 14000, 22000 ] 13 0.003% 100.161% ( 22000, 33000 ] 10 0.002% 100.164% ( 33000, 50000 ] 2 0.000% 100.164% ** Level 3 read latency histogram (micros): Count: 941496 Average: 19.2007 StdDev: 333.35 Min: 1 Median: 2.4358 Max: 67099 Percentiles: P50: 2.44 P75: 3.47 P99: 60.32 P99.9: 1271.83 P99.99: 2268.82 ------------------------------------------------------ [ 0, 1 ] 6562 0.697% 0.697% ( 1, 2 ] 322262 34.229% 34.926% ####### ( 2, 3 ] 325674 34.591% 69.517% ####### ( 3, 4 ] 109525 11.633% 81.150% ## ( 4, 6 ] 128573 13.656% 94.806% ### ( 6, 10 ] 31352 3.330% 98.136% # ( 10, 15 ] 6819 0.724% 98.860% ( 15, 22 ] 770 0.082% 98.942% ( 22, 34 ] 139 0.015% 98.957% ( 34, 51 ] 320 0.034% 98.991% ( 51, 76 ] 228 0.024% 99.015% ( 76, 110 ] 81 0.009% 99.024% ( 110, 170 ] 236 0.025% 99.049% ( 170, 250 ] 697 0.074% 99.123% ( 250, 380 ] 1317 0.140% 99.263% ( 380, 580 ] 2448 0.260% 99.523% ( 580, 870 ] 2432 0.258% 99.781% ( 870, 1300 ] 1198 0.127% 99.908% ( 1300, 1900 ] 521 0.055% 99.964% ( 1900, 2900 ] 672 0.071% 100.035% ( 2900, 4400 ] 904 0.096% 100.131% ( 4400, 6600 ] 226 0.024% 100.155% ( 6600, 9900 ] 77 0.008% 100.163% ( 9900, 14000 ] 32 0.003% 100.167% ( 14000, 22000 ] 53 0.006% 100.172% ( 22000, 33000 ] 32 0.003% 100.176% ( 33000, 50000 ] 17 0.002% 100.177% ( 50000, 75000 ] 2 0.000% 100.178% ** Level 4 read latency histogram (micros): Count: 1584823 Average: 25.3440 StdDev: 396.30 Min: 1 Median: 2.4568 Max: 63396 Percentiles: P50: 2.46 P75: 3.55 P99: 387.34 P99.9: 1182.71 P99.99: 1622.41 ------------------------------------------------------ [ 0, 1 ] 10688 0.674% 0.674% ( 1, 2 ] 536172 33.832% 34.506% ####### ( 2, 3 ] 537582 33.921% 68.427% ####### ( 3, 4 ] 188683 11.906% 80.332% ## ( 4, 6 ] 218990 13.818% 94.150% ### ( 6, 10 ] 53289 3.362% 97.513% # ( 10, 15 ] 12513 0.790% 98.302% ( 15, 22 ] 1341 0.085% 98.387% ( 22, 34 ] 266 0.017% 98.404% ( 34, 51 ] 540 0.034% 98.438% ( 51, 76 ] 468 0.030% 98.467% ( 76, 110 ] 178 0.011% 98.479% ( 110, 170 ] 838 0.053% 98.531% ( 170, 250 ] 2936 0.185% 98.717% ( 250, 380 ] 4251 0.268% 98.985% ( 380, 580 ] 6529 0.412% 99.397% ( 580, 870 ] 5975 0.377% 99.774% ( 870, 1300 ] 2749 0.173% 99.947% ( 1300, 1900 ] 1259 0.079% 100.027% ( 1900, 2900 ] 1519 0.096% 100.123% ( 2900, 4400 ] 1818 0.115% 100.237% ( 4400, 6600 ] 575 0.036% 100.274% ( 6600, 9900 ] 189 0.012% 100.286% ( 9900, 14000 ] 53 0.003% 100.289% ( 14000, 22000 ] 96 0.006% 100.295% ( 22000, 33000 ] 86 0.005% 100.300% ( 33000, 50000 ] 35 0.002% 100.303% ( 50000, 75000 ] 7 0.000% 100.303% ** Level 5 read latency histogram (micros): Count: 17056 Average: 992.8682 StdDev: 2270.90 Min: 97 Median: 548.7346 Max: 65327 Percentiles: P50: 548.73 P75: 857.17 P99: 6136.03 P99.9: 39003.43 P99.99: 65327.00 ------------------------------------------------------ ( 76, 110 ] 18 0.106% 0.106% ( 110, 170 ] 500 2.932% 3.037% # ( 170, 250 ] 1884 11.046% 14.083% ## ( 250, 380 ] 2699 15.824% 29.907% ### ( 380, 580 ] 4062 23.816% 53.723% ##### ( 580, 870 ] 3797 22.262% 75.985% #### ( 870, 1300 ] 1590 9.322% 85.307% ## ( 1300, 1900 ] 586 3.436% 88.743% # ( 1900, 2900 ] 662 3.881% 92.624% # ( 2900, 4400 ] 902 5.288% 97.913% # ( 4400, 6600 ] 235 1.378% 99.291% ( 6600, 9900 ] 47 0.276% 99.566% ( 9900, 14000 ] 10 0.059% 99.625% ( 14000, 22000 ] 20 0.117% 99.742% ( 22000, 33000 ] 22 0.129% 99.871% ( 33000, 50000 ] 14 0.082% 99.953% ( 50000, 75000 ] 9 0.053% 100.006% ** DB Stats ** Uptime(secs): 13.2 total, 6.3 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 148.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.650 H:M:S, 27.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 155.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.872 H:M:S, 29.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-16:04:49 ... thread 0: (1000000,3000000) ops and (263075.9,177251.8) ops/second in (3.801184,16.925075) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 2.45 GB 37.6 1.7 0.0 1.7 4.4 2.8 0.0 1.6 59.4 158.0 28.60 16.09 45 0.636 1724K 9142 0.0 0.0 L1 8/8 435.59 MB 0.0 0.7 0.5 0.1 0.6 0.5 0.0 1.2 56.6 56.2 11.84 3.80 2 5.918 680K 4749 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 93.3 93.3 1.12 0.56 1 1.124 106K 0 0.0 0.0 L3 19/0 947.20 MB 0.9 3.1 1.9 1.2 3.0 1.8 0.1 1.5 108.5 103.1 29.47 16.24 13 2.267 2300K 11K 0.0 0.0 L4 153/0 9.64 GB 1.0 8.8 2.8 6.0 7.7 1.6 0.6 2.8 130.0 113.3 69.45 42.33 33 2.105 1745K 0 0.0 0.0 L5 152/0 11.51 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 349/22 24.95 GB 0.0 14.4 5.3 9.0 15.8 6.8 3.2 5.7 104.6 115.3 140.48 79.02 94 1.494 6556K 25K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.4 5.3 9.0 15.8 6.8 3.2 5.7 104.6 115.3 140.48 79.02 94 1.494 6556K 25K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.4 5.3 9.0 13.1 4.0 0.0 0.0 117.8 107.1 124.84 70.50 55 2.270 6556K 25K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 181.0 15.64 8.52 39 0.401 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.0 total, 16.9 interval Flush(GB): cumulative 2.763, interval 2.763 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.82 GB write, 951.72 MB/s write, 14.36 GB read, 863.93 MB/s read, 140.5 seconds Interval compaction: 15.82 GB write, 956.68 MB/s write, 14.36 GB read, 868.43 MB/s read, 140.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 34, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 653098 Average: 34.4804 StdDev: 410.56 Min: 0 Median: 1.9158 Max: 75996 Percentiles: P50: 1.92 P75: 2.93 P99: 699.12 P99.9: 3432.61 P99.99: 4364.63 ------------------------------------------------------ [ 0, 1 ] 53862 8.247% 8.247% ## ( 1, 2 ] 297762 45.592% 53.839% ######### ( 2, 3 ] 148174 22.688% 76.527% ##### ( 3, 4 ] 50648 7.755% 84.282% ## ( 4, 6 ] 53525 8.196% 92.478% ## ( 6, 10 ] 13942 2.135% 94.613% ( 10, 15 ] 2919 0.447% 95.060% ( 15, 22 ] 404 0.062% 95.121% ( 22, 34 ] 75 0.011% 95.133% ( 34, 51 ] 55 0.008% 95.141% ( 51, 76 ] 55 0.008% 95.150% ( 76, 110 ] 162 0.025% 95.175% ( 110, 170 ] 4937 0.756% 95.930% ( 170, 250 ] 10203 1.562% 97.493% ( 250, 380 ] 3646 0.558% 98.051% ( 380, 580 ] 4474 0.685% 98.736% ( 580, 870 ] 4197 0.643% 99.379% ( 870, 1300 ] 1851 0.283% 99.662% ( 1300, 1900 ] 578 0.089% 99.751% ( 1900, 2900 ] 640 0.098% 99.849% ( 2900, 4400 ] 946 0.145% 99.993% ( 4400, 6600 ] 227 0.035% 100.028% ( 6600, 9900 ] 60 0.009% 100.037% ( 9900, 14000 ] 17 0.003% 100.040% ( 14000, 22000 ] 20 0.003% 100.043% ( 22000, 33000 ] 36 0.006% 100.049% ( 33000, 50000 ] 18 0.003% 100.051% ( 50000, 75000 ] 1 0.000% 100.051% ( 75000, 110000 ] 1 0.000% 100.052% ** Level 1 read latency histogram (micros): Count: 62801 Average: 27.5912 StdDev: 302.22 Min: 1 Median: 2.4488 Max: 39538 Percentiles: P50: 2.45 P75: 3.73 P99: 440.27 P99.9: 3297.79 P99.99: 8395.13 ------------------------------------------------------ [ 0, 1 ] 486 0.774% 0.774% ( 1, 2 ] 22074 35.149% 35.923% ####### ( 2, 3 ] 19696 31.363% 67.286% ###### ( 3, 4 ] 6612 10.528% 77.814% ## ( 4, 6 ] 7805 12.428% 90.242% ## ( 6, 10 ] 2055 3.272% 93.514% # ( 10, 15 ] 397 0.632% 94.147% ( 15, 22 ] 62 0.099% 94.245% ( 22, 34 ] 12 0.019% 94.264% ( 34, 51 ] 8 0.013% 94.277% ( 51, 76 ] 7 0.011% 94.288% ( 76, 110 ] 29 0.046% 94.334% ( 110, 170 ] 823 1.310% 95.645% ( 170, 250 ] 1651 2.629% 98.274% # ( 250, 380 ] 368 0.586% 98.860% ( 380, 580 ] 292 0.465% 99.325% ( 580, 870 ] 189 0.301% 99.626% ( 870, 1300 ] 83 0.132% 99.758% ( 1300, 1900 ] 29 0.046% 99.804% ( 1900, 2900 ] 48 0.076% 99.881% ( 2900, 4400 ] 46 0.073% 99.954% ( 4400, 6600 ] 20 0.032% 99.986% ( 6600, 9900 ] 5 0.008% 99.994% ( 9900, 14000 ] 2 0.003% 99.997% ( 14000, 22000 ] 2 0.003% 100.000% ( 22000, 33000 ] 2 0.003% 100.003% ( 33000, 50000 ] 1 0.002% 100.005% ** Level 2 read latency histogram (micros): Count: 434676 Average: 16.0031 StdDev: 264.51 Min: 1 Median: 2.3915 Max: 39436 Percentiles: P50: 2.39 P75: 3.43 P99: 14.36 P99.9: 1303.24 P99.99: 2335.20 ------------------------------------------------------ [ 0, 1 ] 3129 0.720% 0.720% ( 1, 2 ] 157973 36.343% 37.063% ####### ( 2, 3 ] 143632 33.043% 70.106% ####### ( 3, 4 ] 49234 11.327% 81.433% ## ( 4, 6 ] 58795 13.526% 94.959% ### ( 6, 10 ] 14432 3.320% 98.279% # ( 10, 15 ] 3595 0.827% 99.106% ( 15, 22 ] 566 0.130% 99.236% ( 22, 34 ] 76 0.017% 99.254% ( 34, 51 ] 126 0.029% 99.283% ( 51, 76 ] 85 0.020% 99.302% ( 76, 110 ] 33 0.008% 99.310% ( 110, 170 ] 200 0.046% 99.356% ( 170, 250 ] 391 0.090% 99.446% ( 250, 380 ] 383 0.088% 99.534% ( 380, 580 ] 668 0.154% 99.688% ( 580, 870 ] 592 0.136% 99.824% ( 870, 1300 ] 330 0.076% 99.900% ( 1300, 1900 ] 245 0.056% 99.956% ( 1900, 2900 ] 339 0.078% 100.034% ( 2900, 4400 ] 341 0.078% 100.112% ( 4400, 6600 ] 124 0.029% 100.141% ( 6600, 9900 ] 59 0.014% 100.155% ( 9900, 14000 ] 15 0.003% 100.158% ( 14000, 22000 ] 13 0.003% 100.161% ( 22000, 33000 ] 10 0.002% 100.163% ( 33000, 50000 ] 2 0.000% 100.164% ** Level 3 read latency histogram (micros): Count: 945581 Average: 19.9756 StdDev: 332.87 Min: 1 Median: 2.4421 Max: 67099 Percentiles: P50: 2.44 P75: 3.50 P99: 229.69 P99.9: 1270.38 P99.99: 2268.22 ------------------------------------------------------ [ 0, 1 ] 6562 0.694% 0.694% ( 1, 2 ] 322262 34.081% 34.775% ####### ( 2, 3 ] 325674 34.442% 69.216% ####### ( 3, 4 ] 109525 11.583% 80.799% ## ( 4, 6 ] 128573 13.597% 94.397% ### ( 6, 10 ] 31352 3.316% 97.712% # ( 10, 15 ] 6819 0.721% 98.433% ( 15, 22 ] 770 0.081% 98.515% ( 22, 34 ] 139 0.015% 98.529% ( 34, 51 ] 320 0.034% 98.563% ( 51, 76 ] 228 0.024% 98.587% ( 76, 110 ] 127 0.013% 98.601% ( 110, 170 ] 1474 0.156% 98.757% ( 170, 250 ] 3083 0.326% 99.083% ( 250, 380 ] 1624 0.172% 99.255% ( 380, 580 ] 2541 0.269% 99.523% ( 580, 870 ] 2446 0.259% 99.782% ( 870, 1300 ] 1199 0.127% 99.909% ( 1300, 1900 ] 521 0.055% 99.964% ( 1900, 2900 ] 672 0.071% 100.035% ( 2900, 4400 ] 904 0.096% 100.131% ( 4400, 6600 ] 226 0.024% 100.154% ( 6600, 9900 ] 77 0.008% 100.163% ( 9900, 14000 ] 32 0.003% 100.166% ( 14000, 22000 ] 53 0.006% 100.172% ( 22000, 33000 ] 32 0.003% 100.175% ( 33000, 50000 ] 17 0.002% 100.177% ( 50000, 75000 ] 2 0.000% 100.177% ** Level 4 read latency histogram (micros): Count: 1614095 Average: 28.3071 StdDev: 393.43 Min: 1 Median: 2.4838 Max: 63396 Percentiles: P50: 2.48 P75: 3.67 P99: 399.23 P99.9: 1178.18 P99.99: 1621.01 ------------------------------------------------------ [ 0, 1 ] 10688 0.662% 0.662% ( 1, 2 ] 536195 33.220% 33.882% ####### ( 2, 3 ] 537707 33.313% 67.195% ####### ( 3, 4 ] 188996 11.709% 78.904% ## ( 4, 6 ] 219855 13.621% 92.525% ### ( 6, 10 ] 53383 3.307% 95.832% # ( 10, 15 ] 12545 0.777% 96.609% ( 15, 22 ] 1348 0.084% 96.693% ( 22, 34 ] 271 0.017% 96.710% ( 34, 51 ] 540 0.033% 96.743% ( 51, 76 ] 468 0.029% 96.772% ( 76, 110 ] 469 0.029% 96.801% ( 110, 170 ] 9558 0.592% 97.393% ( 170, 250 ] 18600 1.152% 98.546% ( 250, 380 ] 6640 0.411% 98.957% ( 380, 580 ] 7188 0.445% 99.403% ( 580, 870 ] 6059 0.375% 99.778% ( 870, 1300 ] 2750 0.170% 99.948% ( 1300, 1900 ] 1259 0.078% 100.026% ( 1900, 2900 ] 1521 0.094% 100.121% ( 2900, 4400 ] 1818 0.113% 100.233% ( 4400, 6600 ] 575 0.036% 100.269% ( 6600, 9900 ] 189 0.012% 100.280% ( 9900, 14000 ] 53 0.003% 100.284% ( 14000, 22000 ] 96 0.006% 100.290% ( 22000, 33000 ] 86 0.005% 100.295% ( 33000, 50000 ] 35 0.002% 100.297% ( 50000, 75000 ] 7 0.000% 100.298% ** Level 5 read latency histogram (micros): Count: 36967 Average: 564.7680 StdDev: 1593.34 Min: 91 Median: 239.9900 Max: 65327 Percentiles: P50: 239.99 P75: 523.43 P99: 4375.60 P99.9: 25016.50 P99.99: 59175.83 ------------------------------------------------------ ( 76, 110 ] 239 0.647% 0.647% ( 110, 170 ] 6823 18.457% 19.104% #### ( 170, 250 ] 13055 35.315% 54.419% ####### ( 250, 380 ] 4343 11.748% 66.167% ## ( 380, 580 ] 4553 12.316% 78.484% ## ( 580, 870 ] 3858 10.436% 88.920% ## ( 870, 1300 ] 1590 4.301% 93.221% # ( 1300, 1900 ] 586 1.585% 94.806% ( 1900, 2900 ] 663 1.793% 96.600% ( 2900, 4400 ] 902 2.440% 99.040% ( 4400, 6600 ] 235 0.636% 99.675% ( 6600, 9900 ] 47 0.127% 99.803% ( 9900, 14000 ] 10 0.027% 99.830% ( 14000, 22000 ] 20 0.054% 99.884% ( 22000, 33000 ] 22 0.060% 99.943% ( 33000, 50000 ] 14 0.038% 99.981% ( 50000, 75000 ] 9 0.024% 100.005% ** DB Stats ** Uptime(secs): 17.0 total, 3.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 173.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.650 H:M:S, 21.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 258.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 511.857 micros/op 7777 ops/sec 20.185 seconds 156996 operations; 7.5 MB/s (39999 of 39999 found) Microseconds per read: Count: 156996 Average: 511.8859 StdDev: 1656.97 Min: 3 Median: 251.7169 Max: 117004 Percentiles: P50: 251.72 P75: 440.18 P99: 4314.05 P99.9: 25259.67 P99.99: 62841.36 ------------------------------------------------------ ( 2, 3 ] 10 0.006% 0.006% ( 3, 4 ] 21 0.013% 0.020% ( 4, 6 ] 95 0.061% 0.080% ( 6, 10 ] 299 0.190% 0.271% ( 10, 15 ] 398 0.254% 0.524% ( 15, 22 ] 727 0.463% 0.987% ( 22, 34 ] 3674 2.340% 3.327% ( 34, 51 ] 3252 2.071% 5.399% ( 51, 76 ] 639 0.407% 5.806% ( 76, 110 ] 96 0.061% 5.867% ( 110, 170 ] 6852 4.364% 10.231% # ( 170, 250 ] 61989 39.484% 49.716% ######## ( 250, 380 ] 33771 21.511% 71.227% #### ( 380, 580 ] 19688 12.540% 83.767% ### ( 580, 870 ] 12410 7.905% 91.672% ## ( 870, 1300 ] 5506 3.507% 95.179% # ( 1300, 1900 ] 2107 1.342% 96.521% ( 1900, 2900 ] 1754 1.117% 97.638% ( 2900, 4400 ] 2268 1.445% 99.083% ( 4400, 6600 ] 734 0.468% 99.550% ( 6600, 9900 ] 254 0.162% 99.712% ( 9900, 14000 ] 123 0.078% 99.790% ( 14000, 22000 ] 140 0.089% 99.880% ( 22000, 33000 ] 108 0.069% 99.948% ( 33000, 50000 ] 54 0.034% 99.983% ( 50000, 75000 ] 22 0.014% 99.997% ( 75000, 110000 ] 2 0.001% 99.998% ( 110000, 170000 ] 3 0.002% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2325911 rocksdb.bloom.filter.full.positive COUNT : 178472 rocksdb.bloom.filter.full.true.positive COUNT : 156215 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 781 rocksdb.memtable.miss COUNT : 156215 rocksdb.l0.hit COUNT : 15018 rocksdb.l1.hit COUNT : 2501 rocksdb.l2andup.hit COUNT : 138696 rocksdb.compaction.key.drop.new COUNT : 1366739 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3701839 rocksdb.number.keys.read COUNT : 156996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3820297848 rocksdb.bytes.read COUNT : 156996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 563 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 4240258 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16550655081 rocksdb.compact.write.bytes COUNT : 15142368081 rocksdb.flush.write.bytes COUNT : 3758852963 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 29 rocksdb.number.superversion_acquires COUNT : 728 rocksdb.number.superversion_releases COUNT : 709 rocksdb.number.superversion_cleanups COUNT : 180 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 196 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3734924288 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7321600 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 16804003852 rocksdb.non.last.level.read.count COUNT : 4033438 rocksdb.block.checksum.compute.count COUNT : 4191369 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 249.464023 P95 : 1277.227463 P99 : 4312.140969 P100 : 117001.000000 COUNT : 156996 SUM : 80188835 rocksdb.db.write.micros P50 : 1.636426 P95 : 5.185839 P99 : 7.840944 P100 : 600039.000000 COUNT : 3701839 SUM : 15043774 rocksdb.compaction.times.micros P50 : 2158064.516129 P95 : 3985000.000000 P99 : 7886000.000000 P100 : 9616813.000000 COUNT : 58 SUM : 127789513 rocksdb.compaction.times.cpu_micros P50 : 1340000.000000 P95 : 1862000.000000 P99 : 2320000.000000 P100 : 2622608.000000 COUNT : 58 SUM : 73373989 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1006.818182 P95 : 7342.500000 P99 : 88880.000000 P100 : 88880.000000 COUNT : 51 SUM : 178815 rocksdb.compaction.outfile.sync.micros P50 : 2420.000000 P95 : 8250.000000 P99 : 11745.000000 P100 : 68865.000000 COUNT : 210 SUM : 699168 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 278.437500 P95 : 2087.500000 P99 : 3641.000000 P100 : 3641.000000 COUNT : 125 SUM : 62628 rocksdb.table.open.io.micros P50 : 5969.333333 P95 : 19515.384615 P99 : 30758.750000 P100 : 110286.000000 COUNT : 563 SUM : 4131059 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.766913 P95 : 9.809950 P99 : 196.712944 P100 : 67651.000000 COUNT : 4010108 SUM : 73163008 rocksdb.read.block.get.micros P50 : 213.890008 P95 : 1132.027681 P99 : 3955.907313 P100 : 76002.000000 COUNT : 180903 SUM : 71928512 rocksdb.write.raw.block.micros P50 : 0.543462 P95 : 1.545019 P99 : 4.669916 P100 : 109688.000000 COUNT : 4579600 SUM : 19679002 rocksdb.numfiles.in.singlecompaction P50 : 3.227273 P95 : 5.650000 P99 : 16.750000 P100 : 18.000000 COUNT : 75 SUM : 282 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560730 P95 : 1102.089744 P99 : 1270.498535 P100 : 599831.000000 COUNT : 5346 SUM : 4240881 rocksdb.sst.read.micros P50 : 2.365186 P95 : 122.723614 P99 : 575.608304 P100 : 75996.000000 COUNT : 4033841 SUM : 130351460 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 156996 SUM : 156996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3701839 SUM : 3820297848 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 235806.451613 P95 : 897284.000000 P99 : 897284.000000 P100 : 897284.000000 COUNT : 51 SUM : 18054616 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 211 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0