[2024-07-12 15:32:41.989327] Starting SPDK v24.09-pre git sha1 719d03c6a / DPDK 23.11.0 initialization... [2024-07-12 15:32:41.989633] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4059354 ] Set seed to 1720791161982798 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-12 15:32:42.097338] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-12 15:32:42.139467] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-12 15:32:42.139522] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 4059354' to capture a snapshot of events at runtime. [2024-07-12 15:32:42.139533] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-12 15:32:42.139564] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-12 15:32:42.139573] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid4059354 for offline analysis/debug. [2024-07-12 15:32:42.139661] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 12 15:32:46 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/12-15:32:53 ... thread 0: (1000000,1000000) ops and (133271.9,133271.9) ops/second in (7.503456,7.503456) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/13 2.12 GB 56.6 0.4 0.0 0.4 1.2 0.9 0.0 1.4 41.2 137.3 9.17 4.05 11 0.834 383K 548 0.0 0.0 L1 7/7 791.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 128.78 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 31/8 2.09 GB 1.4 3.2 1.7 1.5 3.1 1.7 0.0 1.9 110.8 109.9 29.27 14.93 13 2.252 1117K 0 0.0 0.0 L4 203/20 11.41 GB 1.1 3.2 2.0 1.2 3.1 1.9 0.0 1.6 111.6 109.7 29.09 15.06 23 1.265 1550K 0 0.0 0.0 L5 1096/0 90.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1354/48 106.89 GB 0.0 6.7 3.7 3.0 7.5 4.5 0.0 8.7 101.7 113.5 67.54 34.03 47 1.437 3051K 548 0.0 0.0 Int 0/0 0.00 KB 0.0 6.7 3.7 3.0 7.5 4.5 0.0 8.7 101.7 113.5 67.54 34.03 47 1.437 3051K 548 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.7 3.7 3.0 6.6 3.6 0.0 0.0 113.3 111.9 60.61 31.53 37 1.638 3051K 548 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 127.2 6.93 2.50 10 0.693 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.7 total, 7.5 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.49 GB write, 992.22 MB/s write, 6.71 GB read, 888.91 MB/s read, 67.5 seconds Interval compaction: 7.49 GB write, 1021.45 MB/s write, 6.71 GB read, 915.10 MB/s read, 67.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 28, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 322486 Average: 17.6200 StdDev: 199.38 Min: 1 Median: 1.9317 Max: 31084 Percentiles: P50: 1.93 P75: 2.95 P99: 17.38 P99.9: 2780.66 P99.99: 4236.79 ------------------------------------------------------ [ 0, 1 ] 9654 2.994% 2.994% # ( 1, 2 ] 162706 50.454% 53.447% ########## ( 2, 3 ] 73123 22.675% 76.122% ##### ( 3, 4 ] 32090 9.951% 86.073% ## ( 4, 6 ] 33127 10.272% 96.345% ## ( 6, 10 ] 7391 2.292% 98.637% ( 10, 15 ] 1129 0.350% 98.987% ( 15, 22 ] 121 0.038% 99.025% ( 22, 34 ] 12 0.004% 99.028% ( 34, 51 ] 9 0.003% 99.031% ( 51, 76 ] 11 0.003% 99.035% ( 76, 110 ] 9 0.003% 99.037% ( 110, 170 ] 31 0.010% 99.047% ( 170, 250 ] 71 0.022% 99.069% ( 250, 380 ] 156 0.048% 99.117% ( 380, 580 ] 357 0.111% 99.228% ( 580, 870 ] 616 0.191% 99.419% ( 870, 1300 ] 688 0.213% 99.633% ( 1300, 1900 ] 549 0.170% 99.803% ( 1900, 2900 ] 356 0.110% 99.913% ( 2900, 4400 ] 278 0.086% 99.999% ( 4400, 6600 ] 82 0.025% 100.025% ( 6600, 9900 ] 20 0.006% 100.031% ( 9900, 14000 ] 2 0.001% 100.032% ( 22000, 33000 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 110 Average: 1659.3455 StdDev: 1451.67 Min: 110 Median: 1156.6667 Max: 7909 Percentiles: P50: 1156.67 P75: 2050.00 P99: 7909.00 P99.9: 7909.00 P99.99: 7909.00 ------------------------------------------------------ ( 76, 110 ] 1 0.909% 0.909% ( 110, 170 ] 1 0.909% 1.818% ( 170, 250 ] 1 0.909% 2.727% ( 250, 380 ] 4 3.636% 6.364% # ( 380, 580 ] 10 9.091% 15.455% ## ( 580, 870 ] 22 20.000% 35.455% #### ( 870, 1300 ] 24 21.818% 57.273% #### ( 1300, 1900 ] 18 16.364% 73.636% ### ( 1900, 2900 ] 10 9.091% 82.727% ## ( 2900, 4400 ] 15 13.636% 96.364% ### ( 4400, 6600 ] 2 1.818% 98.182% ( 6600, 9900 ] 2 1.818% 100.000% ** Level 2 read latency histogram (micros): Count: 207519 Average: 12.4451 StdDev: 161.04 Min: 1 Median: 1.9735 Max: 24144 Percentiles: P50: 1.97 P75: 3.00 P99: 11.29 P99.9: 1862.62 P99.99: 3034.98 ------------------------------------------------------ [ 0, 1 ] 4716 2.273% 2.273% ( 1, 2 ] 101736 49.025% 51.297% ########## ( 2, 3 ] 49414 23.812% 75.109% ##### ( 3, 4 ] 20930 10.086% 85.195% ## ( 4, 6 ] 22358 10.774% 95.969% ## ( 6, 10 ] 6031 2.906% 98.875% # ( 10, 15 ] 1006 0.485% 99.360% ( 15, 22 ] 140 0.067% 99.428% ( 22, 34 ] 21 0.010% 99.438% ( 34, 51 ] 25 0.012% 99.450% ( 51, 76 ] 15 0.007% 99.457% ( 76, 110 ] 12 0.006% 99.463% ( 110, 170 ] 8 0.004% 99.467% ( 170, 250 ] 24 0.012% 99.478% ( 250, 380 ] 56 0.027% 99.505% ( 380, 580 ] 120 0.058% 99.563% ( 580, 870 ] 233 0.112% 99.675% ( 870, 1300 ] 263 0.127% 99.802% ( 1300, 1900 ] 217 0.105% 99.907% ( 1900, 2900 ] 162 0.078% 99.985% ( 2900, 4400 ] 125 0.060% 100.045% ( 4400, 6600 ] 41 0.020% 100.065% ( 6600, 9900 ] 6 0.003% 100.067% ( 22000, 33000 ] 1 0.000% 100.068% ** Level 3 read latency histogram (micros): Count: 821163 Average: 10.6741 StdDev: 145.80 Min: 1 Median: 2.0037 Max: 15910 Percentiles: P50: 2.00 P75: 3.02 P99: 9.81 P99.9: 1068.13 P99.99: 1613.28 ------------------------------------------------------ [ 0, 1 ] 14291 1.740% 1.740% ( 1, 2 ] 395530 48.167% 49.907% ########## ( 2, 3 ] 203917 24.833% 74.740% ##### ( 3, 4 ] 86552 10.540% 85.280% ## ( 4, 6 ] 92848 11.307% 96.587% ## ( 6, 10 ] 20811 2.534% 99.121% # ( 10, 15 ] 3860 0.470% 99.592% ( 15, 22 ] 501 0.061% 99.653% ( 22, 34 ] 75 0.009% 99.662% ( 34, 51 ] 68 0.008% 99.670% ( 51, 76 ] 61 0.007% 99.677% ( 76, 110 ] 29 0.004% 99.681% ( 110, 170 ] 49 0.006% 99.687% ( 170, 250 ] 101 0.012% 99.699% ( 250, 380 ] 204 0.025% 99.724% ( 380, 580 ] 384 0.047% 99.771% ( 580, 870 ] 689 0.084% 99.855% ( 870, 1300 ] 807 0.098% 99.953% ( 1300, 1900 ] 582 0.071% 100.024% ( 1900, 2900 ] 508 0.062% 100.086% ( 2900, 4400 ] 459 0.056% 100.142% ( 4400, 6600 ] 138 0.017% 100.158% ( 6600, 9900 ] 21 0.003% 100.161% ( 9900, 14000 ] 7 0.001% 100.162% ( 14000, 22000 ] 2 0.000% 100.162% ** Level 4 read latency histogram (micros): Count: 366901 Average: 26.8731 StdDev: 261.47 Min: 1 Median: 2.0353 Max: 34921 Percentiles: P50: 2.04 P75: 3.13 P99: 726.48 P99.9: 2975.57 P99.99: 3931.79 ------------------------------------------------------ [ 0, 1 ] 6016 1.640% 1.640% ( 1, 2 ] 174261 47.495% 49.135% ######### ( 2, 3 ] 89812 24.479% 73.614% ##### ( 3, 4 ] 38761 10.564% 84.178% ## ( 4, 6 ] 40229 10.965% 95.143% ## ( 6, 10 ] 10583 2.884% 98.027% # ( 10, 15 ] 1665 0.454% 98.481% ( 15, 22 ] 196 0.053% 98.534% ( 22, 34 ] 30 0.008% 98.542% ( 34, 51 ] 18 0.005% 98.547% ( 51, 76 ] 36 0.010% 98.557% ( 76, 110 ] 18 0.005% 98.562% ( 110, 170 ] 52 0.014% 98.576% ( 170, 250 ] 125 0.034% 98.610% ( 250, 380 ] 260 0.071% 98.681% ( 380, 580 ] 631 0.172% 98.853% ( 580, 870 ] 1071 0.292% 99.145% ( 870, 1300 ] 1252 0.341% 99.486% ( 1300, 1900 ] 856 0.233% 99.720% ( 1900, 2900 ] 638 0.174% 99.893% ( 2900, 4400 ] 518 0.141% 100.035% ( 4400, 6600 ] 217 0.059% 100.094% ( 6600, 9900 ] 39 0.011% 100.104% ( 9900, 14000 ] 8 0.002% 100.107% ( 14000, 22000 ] 3 0.001% 100.107% ( 33000, 50000 ] 1 0.000% 100.108% ** Level 5 read latency histogram (micros): Count: 11317 Average: 1860.0687 StdDev: 1629.86 Min: 87 Median: 1267.1419 Max: 32871 Percentiles: P50: 1267.14 P75: 2613.00 P99: 7674.26 P99.9: 10366.72 P99.99: 28850.43 ------------------------------------------------------ ( 76, 110 ] 10 0.088% 0.088% ( 110, 170 ] 64 0.566% 0.654% ( 170, 250 ] 160 1.414% 2.068% ( 250, 380 ] 449 3.967% 6.035% # ( 380, 580 ] 1064 9.402% 15.437% ## ( 580, 870 ] 1887 16.674% 32.111% ### ( 870, 1300 ] 2192 19.369% 51.480% #### ( 1300, 1900 ] 1655 14.624% 66.104% ### ( 1900, 2900 ] 1412 12.477% 78.581% ## ( 2900, 4400 ] 1489 13.157% 91.738% ### ( 4400, 6600 ] 773 6.830% 98.569% # ( 6600, 9900 ] 150 1.325% 99.894% ( 9900, 14000 ] 6 0.053% 99.947% ( 14000, 22000 ] 3 0.027% 99.973% ( 22000, 33000 ] 3 0.027% 100.000% ** DB Stats ** Uptime(secs): 7.7 total, 7.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 127.38 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.537 H:M:S, 45.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 131.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.537 H:M:S, 47.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/12-15:32:58 ... thread 0: (1000000,2000000) ops and (198826.7,159579.2) ops/second in (5.029506,12.532962) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.11 GB 163.6 1.5 0.0 1.5 3.4 1.8 0.0 1.8 83.5 183.6 18.86 11.37 30 0.629 1599K 1893 0.0 0.0 L1 7/7 791.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 963.67 MB 1.0 3.4 1.8 1.6 3.4 1.8 0.0 1.9 113.6 112.6 30.84 16.10 14 2.203 1251K 0 0.0 0.0 L4 180/0 9.68 GB 1.0 5.7 3.2 2.5 5.6 3.1 0.0 1.7 121.4 119.2 48.37 26.95 37 1.307 2816K 0 0.0 0.0 L5 1132/0 93.32 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1353/20 107.82 GB 0.0 10.7 5.1 5.6 12.4 6.8 3.0 6.7 111.6 129.5 98.07 54.43 81 1.211 5667K 1893 0.0 0.0 Int 0/0 0.00 KB 0.0 10.7 5.1 5.6 12.4 6.8 3.0 6.7 111.6 129.5 98.07 54.43 81 1.211 5667K 1893 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.7 5.1 5.6 10.6 4.9 0.0 0.0 125.8 124.2 87.05 49.25 56 1.554 5667K 1893 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 171.4 11.02 5.17 25 0.441 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.8 total, 12.5 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.40 GB write, 995.78 MB/s write, 10.69 GB read, 858.33 MB/s read, 98.1 seconds Interval compaction: 12.40 GB write, 1013.35 MB/s write, 10.69 GB read, 873.47 MB/s read, 98.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 40, interval: 46 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 629921 Average: 20.0948 StdDev: 174.17 Min: 0 Median: 1.8064 Max: 31084 Percentiles: P50: 1.81 P75: 2.79 P99: 404.19 P99.9: 2259.79 P99.99: 3672.99 ------------------------------------------------------ [ 0, 1 ] 48683 7.728% 7.728% ## ( 1, 2 ] 330193 52.418% 60.147% ########## ( 2, 3 ] 118869 18.870% 79.017% #### ( 3, 4 ] 48405 7.684% 86.701% ## ( 4, 6 ] 47899 7.604% 94.305% ## ( 6, 10 ] 10322 1.639% 95.944% ( 10, 15 ] 1653 0.262% 96.206% ( 15, 22 ] 187 0.030% 96.236% ( 22, 34 ] 13 0.002% 96.238% ( 34, 51 ] 20 0.003% 96.241% ( 51, 76 ] 19 0.003% 96.244% ( 76, 110 ] 2775 0.441% 96.685% ( 110, 170 ] 8589 1.364% 98.048% ( 170, 250 ] 3769 0.598% 98.647% ( 250, 380 ] 1981 0.314% 98.961% ( 380, 580 ] 2032 0.323% 99.284% ( 580, 870 ] 1693 0.269% 99.552% ( 870, 1300 ] 1236 0.196% 99.749% ( 1300, 1900 ] 749 0.119% 99.868% ( 1900, 2900 ] 570 0.090% 99.958% ( 2900, 4400 ] 392 0.062% 100.020% ( 4400, 6600 ] 107 0.017% 100.037% ( 6600, 9900 ] 25 0.004% 100.041% ( 9900, 14000 ] 5 0.001% 100.042% ( 22000, 33000 ] 1 0.000% 100.042% ** Level 1 read latency histogram (micros): Count: 568 Average: 588.0757 StdDev: 931.94 Min: 81 Median: 215.1064 Max: 7909 Percentiles: P50: 215.11 P75: 643.80 P99: 4267.37 P99.9: 7909.00 P99.99: 7909.00 ------------------------------------------------------ ( 76, 110 ] 48 8.451% 8.451% ## ( 110, 170 ] 183 32.218% 40.669% ###### ( 170, 250 ] 94 16.549% 57.218% ### ( 250, 380 ] 51 8.979% 66.197% ## ( 380, 580 ] 39 6.866% 73.063% # ( 580, 870 ] 50 8.803% 81.866% ## ( 870, 1300 ] 39 6.866% 88.732% # ( 1300, 1900 ] 25 4.401% 93.134% # ( 1900, 2900 ] 16 2.817% 95.951% # ( 2900, 4400 ] 19 3.345% 99.296% # ( 4400, 6600 ] 2 0.352% 99.648% ( 6600, 9900 ] 2 0.352% 100.000% ** Level 2 read latency histogram (micros): Count: 240232 Average: 11.7010 StdDev: 153.39 Min: 1 Median: 1.9699 Max: 24144 Percentiles: P50: 1.97 P75: 2.98 P99: 10.85 P99.9: 1832.45 P99.99: 3081.55 ------------------------------------------------------ [ 0, 1 ] 5266 2.192% 2.192% ( 1, 2 ] 118413 49.291% 51.483% ########## ( 2, 3 ] 57386 23.888% 75.371% ##### ( 3, 4 ] 24063 10.017% 85.387% ## ( 4, 6 ] 25570 10.644% 96.031% ## ( 6, 10 ] 6939 2.888% 98.920% # ( 10, 15 ] 1140 0.475% 99.394% ( 15, 22 ] 159 0.066% 99.461% ( 22, 34 ] 24 0.010% 99.471% ( 34, 51 ] 31 0.013% 99.483% ( 51, 76 ] 17 0.007% 99.490% ( 76, 110 ] 12 0.005% 99.495% ( 110, 170 ] 9 0.004% 99.499% ( 170, 250 ] 25 0.010% 99.510% ( 250, 380 ] 59 0.025% 99.534% ( 380, 580 ] 132 0.055% 99.589% ( 580, 870 ] 254 0.106% 99.695% ( 870, 1300 ] 286 0.119% 99.814% ( 1300, 1900 ] 233 0.097% 99.911% ( 1900, 2900 ] 174 0.072% 99.983% ( 2900, 4400 ] 132 0.055% 100.038% ( 4400, 6600 ] 42 0.017% 100.056% ( 6600, 9900 ] 6 0.002% 100.058% ( 22000, 33000 ] 1 0.000% 100.059% ** Level 3 read latency histogram (micros): Count: 1118304 Average: 9.6993 StdDev: 135.71 Min: 1 Median: 1.9759 Max: 15910 Percentiles: P50: 1.98 P75: 2.97 P99: 9.73 P99.9: 934.41 P99.99: 1479.97 ------------------------------------------------------ [ 0, 1 ] 20462 1.830% 1.830% ( 1, 2 ] 551971 49.358% 51.188% ########## ( 2, 3 ] 274722 24.566% 75.754% ##### ( 3, 4 ] 113707 10.168% 85.921% ## ( 4, 6 ] 120315 10.759% 96.680% ## ( 6, 10 ] 27825 2.488% 99.168% ( 10, 15 ] 4828 0.432% 99.600% ( 15, 22 ] 628 0.056% 99.656% ( 22, 34 ] 89 0.008% 99.664% ( 34, 51 ] 78 0.007% 99.671% ( 51, 76 ] 85 0.008% 99.679% ( 76, 110 ] 106 0.009% 99.688% ( 110, 170 ] 308 0.028% 99.716% ( 170, 250 ] 230 0.021% 99.736% ( 250, 380 ] 310 0.028% 99.764% ( 380, 580 ] 517 0.046% 99.810% ( 580, 870 ] 863 0.077% 99.887% ( 870, 1300 ] 946 0.085% 99.972% ( 1300, 1900 ] 674 0.060% 100.032% ( 1900, 2900 ] 585 0.052% 100.085% ( 2900, 4400 ] 545 0.049% 100.133% ( 4400, 6600 ] 161 0.014% 100.148% ( 6600, 9900 ] 25 0.002% 100.150% ( 9900, 14000 ] 10 0.001% 100.151% ( 14000, 22000 ] 2 0.000% 100.151% ** Level 4 read latency histogram (micros): Count: 649763 Average: 21.5051 StdDev: 217.07 Min: 1 Median: 1.9792 Max: 34921 Percentiles: P50: 1.98 P75: 3.00 P99: 421.55 P99.9: 2378.12 P99.99: 3303.63 ------------------------------------------------------ [ 0, 1 ] 12075 1.858% 1.858% ( 1, 2 ] 319449 49.164% 51.022% ########## ( 2, 3 ] 155734 23.968% 74.990% ##### ( 3, 4 ] 64005 9.851% 84.841% ## ( 4, 6 ] 65922 10.146% 94.986% ## ( 6, 10 ] 17699 2.724% 97.710% # ( 10, 15 ] 2591 0.399% 98.109% ( 15, 22 ] 328 0.050% 98.159% ( 22, 34 ] 41 0.006% 98.166% ( 34, 51 ] 37 0.006% 98.171% ( 51, 76 ] 52 0.008% 98.179% ( 76, 110 ] 682 0.105% 98.284% ( 110, 170 ] 2323 0.358% 98.642% ( 170, 250 ] 1184 0.182% 98.824% ( 250, 380 ] 866 0.133% 98.957% ( 380, 580 ] 1335 0.205% 99.163% ( 580, 870 ] 1699 0.261% 99.424% ( 870, 1300 ] 1654 0.255% 99.679% ( 1300, 1900 ] 1060 0.163% 99.842% ( 1900, 2900 ] 789 0.121% 99.963% ( 2900, 4400 ] 643 0.099% 100.062% ( 4400, 6600 ] 247 0.038% 100.100% ( 6600, 9900 ] 45 0.007% 100.107% ( 9900, 14000 ] 12 0.002% 100.109% ( 14000, 22000 ] 3 0.000% 100.110% ( 33000, 50000 ] 1 0.000% 100.110% ** Level 5 read latency histogram (micros): Count: 52333 Average: 658.4421 StdDev: 1080.62 Min: 76 Median: 218.3709 Max: 32871 Percentiles: P50: 218.37 P75: 678.35 P99: 5684.21 P99.9: 9068.13 P99.99: 13367.93 ------------------------------------------------------ ( 51, 76 ] 1 0.002% 0.002% ( 76, 110 ] 4829 9.227% 9.229% ## ( 110, 170 ] 16968 32.423% 41.652% ###### ( 170, 250 ] 7225 13.806% 55.458% ### ( 250, 380 ] 4163 7.955% 63.413% ## ( 380, 580 ] 4621 8.830% 72.243% ## ( 580, 870 ] 4254 8.129% 80.372% ## ( 870, 1300 ] 3404 6.505% 86.876% # ( 1300, 1900 ] 2218 4.238% 91.115% # ( 1900, 2900 ] 1875 3.583% 94.697% # ( 2900, 4400 ] 1759 3.361% 98.059% # ( 4400, 6600 ] 844 1.613% 99.671% ( 6600, 9900 ] 160 0.306% 99.977% ( 9900, 14000 ] 8 0.015% 99.992% ( 14000, 22000 ] 3 0.006% 99.998% ( 22000, 33000 ] 3 0.006% 100.004% ** DB Stats ** Uptime(secs): 12.8 total, 5.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 154.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.007 H:M:S, 39.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 195.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.469 H:M:S, 29.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-15:33:06 ... thread 0: (1000000,3000000) ops and (131784.5,149097.2) ops/second in (7.588145,20.121107) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 4.02 GB 282.7 3.6 0.0 3.6 6.4 2.8 0.0 2.3 123.7 221.7 29.52 21.53 51 0.579 3709K 7379 0.0 0.0 L1 7/7 791.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 963.67 MB 1.0 3.4 1.8 1.6 3.4 1.8 0.0 1.9 113.6 112.6 30.84 16.10 14 2.203 1251K 0 0.0 0.0 L4 180/0 9.68 GB 1.0 5.7 3.2 2.5 5.6 3.1 0.0 1.7 121.4 119.2 48.37 26.95 37 1.307 2816K 0 0.0 0.0 L5 1132/0 93.32 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1352/16 108.74 GB 0.0 12.7 5.1 7.7 15.4 7.7 3.0 5.4 119.8 145.2 108.73 64.58 102 1.066 7777K 7379 0.0 0.0 Int 0/0 0.00 KB 0.0 12.7 5.1 7.7 15.4 7.7 3.0 5.4 119.8 145.2 108.73 64.58 102 1.066 7777K 7379 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.7 5.1 7.7 12.6 4.9 0.0 0.0 137.6 136.1 94.65 56.76 61 1.552 7777K 7379 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 205.9 14.08 7.82 41 0.343 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.3 total, 20.1 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.41 GB write, 775.78 MB/s write, 12.72 GB read, 640.32 MB/s read, 108.7 seconds Interval compaction: 15.41 GB write, 784.30 MB/s write, 12.72 GB read, 647.35 MB/s read, 108.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 40, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1203526 Average: 19.4325 StdDev: 133.25 Min: 0 Median: 1.6362 Max: 31084 Percentiles: P50: 1.64 P75: 2.42 P99: 307.82 P99.9: 1299.83 P99.99: 2446.86 ------------------------------------------------------ [ 0, 1 ] 191475 15.910% 15.910% ### ( 1, 2 ] 644875 53.582% 69.492% ########### ( 2, 3 ] 159188 13.227% 82.718% ### ( 3, 4 ] 60107 4.994% 87.713% # ( 4, 6 ] 55141 4.582% 92.294% # ( 6, 10 ] 11462 0.952% 93.247% ( 10, 15 ] 1915 0.159% 93.406% ( 15, 22 ] 234 0.019% 93.425% ( 22, 34 ] 19 0.002% 93.427% ( 34, 51 ] 25 0.002% 93.429% ( 51, 76 ] 30 0.002% 93.431% ( 76, 110 ] 11681 0.971% 94.402% ( 110, 170 ] 39423 3.276% 97.678% # ( 170, 250 ] 13648 1.134% 98.812% ( 250, 380 ] 5099 0.424% 99.235% ( 380, 580 ] 4363 0.363% 99.598% ( 580, 870 ] 2336 0.194% 99.792% ( 870, 1300 ] 1302 0.108% 99.900% ( 1300, 1900 ] 760 0.063% 99.963% ( 1900, 2900 ] 590 0.049% 100.012% ( 2900, 4400 ] 399 0.033% 100.045% ( 4400, 6600 ] 107 0.009% 100.054% ( 6600, 9900 ] 25 0.002% 100.056% ( 9900, 14000 ] 5 0.000% 100.057% ( 22000, 33000 ] 1 0.000% 100.057% ** Level 1 read latency histogram (micros): Count: 1809 Average: 307.3024 StdDev: 563.36 Min: 76 Median: 155.5322 Max: 7909 Percentiles: P50: 155.53 P75: 234.76 P99: 3287.63 P99.9: 6915.15 P99.99: 7909.00 ------------------------------------------------------ ( 51, 76 ] 1 0.055% 0.055% ( 76, 110 ] 219 12.106% 12.161% ## ( 110, 170 ] 902 49.862% 62.023% ########## ( 170, 250 ] 290 16.031% 78.054% ### ( 250, 380 ] 120 6.633% 84.688% # ( 380, 580 ] 109 6.025% 90.713% # ( 580, 870 ] 63 3.483% 94.196% # ( 870, 1300 ] 40 2.211% 96.407% ( 1300, 1900 ] 26 1.437% 97.844% ( 1900, 2900 ] 16 0.884% 98.729% ( 2900, 4400 ] 19 1.050% 99.779% ( 4400, 6600 ] 2 0.111% 99.889% ( 6600, 9900 ] 2 0.111% 100.000% ** Level 2 read latency histogram (micros): Count: 240232 Average: 11.7010 StdDev: 153.39 Min: 1 Median: 1.9699 Max: 24144 Percentiles: P50: 1.97 P75: 2.98 P99: 10.85 P99.9: 1832.45 P99.99: 3081.55 ------------------------------------------------------ [ 0, 1 ] 5266 2.192% 2.192% ( 1, 2 ] 118413 49.291% 51.483% ########## ( 2, 3 ] 57386 23.888% 75.371% ##### ( 3, 4 ] 24063 10.017% 85.387% ## ( 4, 6 ] 25570 10.644% 96.031% ## ( 6, 10 ] 6939 2.888% 98.920% # ( 10, 15 ] 1140 0.475% 99.394% ( 15, 22 ] 159 0.066% 99.461% ( 22, 34 ] 24 0.010% 99.471% ( 34, 51 ] 31 0.013% 99.483% ( 51, 76 ] 17 0.007% 99.490% ( 76, 110 ] 12 0.005% 99.495% ( 110, 170 ] 9 0.004% 99.499% ( 170, 250 ] 25 0.010% 99.510% ( 250, 380 ] 59 0.025% 99.534% ( 380, 580 ] 132 0.055% 99.589% ( 580, 870 ] 254 0.106% 99.695% ( 870, 1300 ] 286 0.119% 99.814% ( 1300, 1900 ] 233 0.097% 99.911% ( 1900, 2900 ] 174 0.072% 99.983% ( 2900, 4400 ] 132 0.055% 100.038% ( 4400, 6600 ] 42 0.017% 100.056% ( 6600, 9900 ] 6 0.002% 100.058% ( 22000, 33000 ] 1 0.000% 100.059% ** Level 3 read latency histogram (micros): Count: 1119967 Average: 9.9390 StdDev: 135.80 Min: 1 Median: 1.9774 Max: 15910 Percentiles: P50: 1.98 P75: 2.97 P99: 9.97 P99.9: 934.81 P99.99: 1479.82 ------------------------------------------------------ [ 0, 1 ] 20462 1.827% 1.827% ( 1, 2 ] 551971 49.285% 51.112% ########## ( 2, 3 ] 274722 24.529% 75.641% ##### ( 3, 4 ] 113707 10.153% 85.794% ## ( 4, 6 ] 120315 10.743% 96.537% ## ( 6, 10 ] 27825 2.484% 99.021% ( 10, 15 ] 4828 0.431% 99.452% ( 15, 22 ] 628 0.056% 99.508% ( 22, 34 ] 89 0.008% 99.516% ( 34, 51 ] 78 0.007% 99.523% ( 51, 76 ] 85 0.008% 99.531% ( 76, 110 ] 373 0.033% 99.564% ( 110, 170 ] 1225 0.109% 99.673% ( 170, 250 ] 537 0.048% 99.721% ( 250, 380 ] 409 0.037% 99.758% ( 380, 580 ] 568 0.051% 99.808% ( 580, 870 ] 882 0.079% 99.887% ( 870, 1300 ] 949 0.085% 99.972% ( 1300, 1900 ] 674 0.060% 100.032% ( 1900, 2900 ] 585 0.052% 100.084% ( 2900, 4400 ] 545 0.049% 100.133% ( 4400, 6600 ] 161 0.014% 100.147% ( 6600, 9900 ] 25 0.002% 100.150% ( 9900, 14000 ] 10 0.001% 100.151% ( 14000, 22000 ] 2 0.000% 100.151% ** Level 4 read latency histogram (micros): Count: 666333 Average: 24.8078 StdDev: 216.13 Min: 1 Median: 2.0097 Max: 34921 Percentiles: P50: 2.01 P75: 3.18 P99: 475.90 P99.9: 2357.91 P99.99: 3297.43 ------------------------------------------------------ [ 0, 1 ] 12075 1.812% 1.812% ( 1, 2 ] 319573 47.960% 49.772% ########## ( 2, 3 ] 156215 23.444% 73.216% ##### ( 3, 4 ] 64412 9.667% 82.883% ## ( 4, 6 ] 66678 10.007% 92.889% ## ( 6, 10 ] 17780 2.668% 95.558% # ( 10, 15 ] 2614 0.392% 95.950% ( 15, 22 ] 330 0.050% 96.000% ( 22, 34 ] 42 0.006% 96.006% ( 34, 51 ] 37 0.006% 96.011% ( 51, 76 ] 55 0.008% 96.020% ( 76, 110 ] 3119 0.468% 96.488% ( 110, 170 ] 10491 1.574% 98.062% ( 170, 250 ] 3696 0.555% 98.617% ( 250, 380 ] 1597 0.240% 98.857% ( 380, 580 ] 1993 0.299% 99.156% ( 580, 870 ] 1859 0.279% 99.435% ( 870, 1300 ] 1677 0.252% 99.686% ( 1300, 1900 ] 1061 0.159% 99.846% ( 1900, 2900 ] 792 0.119% 99.964% ( 2900, 4400 ] 643 0.096% 100.061% ( 4400, 6600 ] 247 0.037% 100.098% ( 6600, 9900 ] 45 0.007% 100.105% ( 9900, 14000 ] 12 0.002% 100.107% ( 14000, 22000 ] 3 0.000% 100.107% ( 33000, 50000 ] 1 0.000% 100.107% ** Level 5 read latency histogram (micros): Count: 159168 Average: 332.4027 StdDev: 666.42 Min: 75 Median: 154.7766 Max: 32871 Percentiles: P50: 154.78 P75: 234.00 P99: 3901.98 P99.9: 6679.04 P99.99: 9633.59 ------------------------------------------------------ ( 51, 76 ] 7 0.004% 0.004% ( 76, 110 ] 22357 14.046% 14.051% ### ( 110, 170 ] 76674 48.172% 62.222% ########## ( 170, 250 ] 25421 15.971% 78.193% ### ( 250, 380 ] 9767 6.136% 84.330% # ( 380, 580 ] 9084 5.707% 90.037% # ( 580, 870 ] 5408 3.398% 93.435% # ( 870, 1300 ] 3541 2.225% 95.659% ( 1300, 1900 ] 2234 1.404% 97.063% ( 1900, 2900 ] 1907 1.198% 98.261% ( 2900, 4400 ] 1761 1.106% 99.367% ( 4400, 6600 ] 844 0.530% 99.898% ( 6600, 9900 ] 160 0.101% 99.998% ( 9900, 14000 ] 8 0.005% 100.003% ( 14000, 22000 ] 3 0.002% 100.005% ( 22000, 33000 ] 3 0.002% 100.007% ** DB Stats ** Uptime(secs): 20.3 total, 7.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 145.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.022 H:M:S, 44.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 129.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.015 H:M:S, 52.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 233.839 micros/op 17096 ops/sec 60.130 seconds 1027996 operations; 16.6 MB/s (266999 of 266999 found) Microseconds per read: Count: 1027996 Average: 233.8411 StdDev: 701.08 Min: 2 Median: 172.3284 Max: 87528 Percentiles: P50: 172.33 P75: 230.57 P99: 987.63 P99.9: 11263.34 P99.99: 30313.48 ------------------------------------------------------ ( 1, 2 ] 2 0.000% 0.000% ( 2, 3 ] 30 0.003% 0.003% ( 3, 4 ] 44 0.004% 0.007% ( 4, 6 ] 81 0.008% 0.015% ( 6, 10 ] 368 0.036% 0.051% ( 10, 15 ] 3963 0.386% 0.437% ( 15, 22 ] 3548 0.345% 0.782% ( 22, 34 ] 13300 1.294% 2.075% ( 34, 51 ] 3194 0.311% 2.386% ( 51, 76 ] 358 0.035% 2.421% ( 76, 110 ] 18650 1.814% 4.235% ( 110, 170 ] 460186 44.765% 49.001% ######### ( 170, 250 ] 352996 34.338% 83.339% ####### ( 250, 380 ] 105520 10.265% 93.603% ## ( 380, 580 ] 39954 3.887% 97.490% # ( 580, 870 ] 14128 1.374% 98.864% ( 870, 1300 ] 5096 0.496% 99.360% ( 1300, 1900 ] 2159 0.210% 99.570% ( 1900, 2900 ] 1563 0.152% 99.722% ( 2900, 4400 ] 1089 0.106% 99.828% ( 4400, 6600 ] 412 0.040% 99.868% ( 6600, 9900 ] 192 0.019% 99.887% ( 9900, 14000 ] 406 0.039% 99.926% ( 14000, 22000 ] 497 0.048% 99.975% ( 22000, 33000 ] 208 0.020% 99.995% ( 33000, 50000 ] 44 0.004% 99.999% ( 50000, 75000 ] 7 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 16878615 rocksdb.bloom.filter.full.positive COUNT : 1191684 rocksdb.bloom.filter.full.true.positive COUNT : 1027609 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 387 rocksdb.memtable.miss COUNT : 1027609 rocksdb.l0.hit COUNT : 41647 rocksdb.l1.hit COUNT : 13912 rocksdb.l2andup.hit COUNT : 972050 rocksdb.compaction.key.drop.new COUNT : 186565 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3907425 rocksdb.number.keys.read COUNT : 1027996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4032462600 rocksdb.bytes.read COUNT : 1027996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1599 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 45012917 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 18772532928 rocksdb.compact.write.bytes COUNT : 18574306731 rocksdb.flush.write.bytes COUNT : 4029564107 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 31 rocksdb.number.superversion_acquires COUNT : 785 rocksdb.number.superversion_releases COUNT : 760 rocksdb.number.superversion_cleanups COUNT : 194 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 235 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3997011968 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1501184 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 22843237324 rocksdb.non.last.level.read.count COUNT : 5375251 rocksdb.block.checksum.compute.count COUNT : 5748387 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 170.540664 P95 : 450.193294 P99 : 985.687811 P100 : 87524.000000 COUNT : 1027996 SUM : 239441353 rocksdb.db.write.micros P50 : 1.527409 P95 : 4.544617 P99 : 12.389691 P100 : 919518.000000 COUNT : 3907425 SUM : 54872033 rocksdb.compaction.times.micros P50 : 1462500.000000 P95 : 3656000.000000 P99 : 38440000.000000 P100 : 39828537.000000 COUNT : 66 SUM : 141211148 rocksdb.compaction.times.cpu_micros P50 : 912307.692308 P95 : 1873750.000000 P99 : 11228000.000000 P100 : 13116647.000000 COUNT : 66 SUM : 76508274 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 814.230769 P95 : 146000.000000 P99 : 307200.000000 P100 : 351286.000000 COUNT : 56 SUM : 1048608 rocksdb.compaction.outfile.sync.micros P50 : 31166.666667 P95 : 224000.000000 P99 : 469300.000000 P100 : 531768.000000 COUNT : 212 SUM : 12972590 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 250.000000 P95 : 4088.461538 P99 : 6350.666667 P100 : 16184.000000 COUNT : 134 SUM : 147548 rocksdb.table.open.io.micros P50 : 9546.995192 P95 : 20619.117647 P99 : 27847.187500 P100 : 58704.000000 COUNT : 1599 SUM : 15602930 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.951970 P95 : 97.440848 P99 : 212.092144 P100 : 15975.000000 COUNT : 4544955 SUM : 83928041 rocksdb.read.block.get.micros P50 : 139.757128 P95 : 316.985914 P99 : 871.464500 P100 : 34928.000000 COUNT : 1201859 SUM : 202319572 rocksdb.write.raw.block.micros P50 : 0.526012 P95 : 0.999422 P99 : 3.340824 P100 : 52327.000000 COUNT : 5474862 SUM : 15264370 rocksdb.numfiles.in.singlecompaction P50 : 2.891892 P95 : 5.050000 P99 : 24.640000 P100 : 34.000000 COUNT : 78 SUM : 307 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.580162 P95 : 2191.538166 P99 : 2759.044112 P100 : 919354.000000 COUNT : 184936 SUM : 45029220 rocksdb.sst.read.micros P50 : 2.271819 P95 : 169.471944 P99 : 469.206230 P100 : 34921.000000 COUNT : 5375337 SUM : 268821226 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1027996 SUM : 1027996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3907425 SUM : 4032462600 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 222093.023256 P95 : 962000.000000 P99 : 1152400.000000 P100 : 1164620.000000 COUNT : 56 SUM : 17062732 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 238 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0