[2024-11-05 12:25:32.423175] Starting SPDK v25.01-pre git sha1 1aeff8917 / DPDK 24.03.0 initialization... [2024-11-05 12:25:32.423290] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3736241 ] Set seed to 1730805932420605 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-05 12:25:32.561388] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-05 12:25:32.667341] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-05 12:25:32.667396] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3736241' to capture a snapshot of events at runtime. [2024-11-05 12:25:32.667409] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-05 12:25:32.667422] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-05 12:25:32.667432] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3736241 for offline analysis/debug. [2024-11-05 12:25:32.668682] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 5 12:25:35 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/05-12:25:40 ... thread 0: (1000000,1000000) ops and (223739.8,223739.8) ops/second in (4.469478,4.469478) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 3.81 GB 87.7 0.7 0.0 0.7 1.6 0.9 0.0 1.9 135.2 292.2 5.59 5.11 17 0.329 766K 3714 0.0 0.0 L1 3/3 187.15 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 991.54 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 128/0 9.65 GB 1.0 0.5 0.3 0.2 0.5 0.3 0.0 1.5 165.5 163.2 2.88 2.34 3 0.959 308K 0 0.0 0.0 L5 128/0 10.52 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 294/15 25.13 GB 0.0 1.2 0.3 0.9 2.1 1.1 0.7 2.4 145.5 248.3 8.46 7.46 20 0.423 1075K 3714 0.0 0.0 Int 0/0 0.00 KB 0.0 1.2 0.3 0.9 2.1 1.1 0.7 2.4 145.5 248.3 8.46 7.46 20 0.423 1075K 3714 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.2 0.3 0.9 1.2 0.3 0.0 0.0 213.9 212.1 5.76 5.16 6 0.959 1075K 3714 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 325.3 2.71 2.29 14 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.6 total, 4.5 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.05 GB write, 460.42 MB/s write, 1.20 GB read, 269.72 MB/s read, 8.5 seconds Interval compaction: 2.05 GB write, 469.82 MB/s write, 1.20 GB read, 275.23 MB/s read, 8.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 0, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 229528 Average: 34.4626 StdDev: 124.04 Min: 1 Median: 1.5027 Max: 18304 Percentiles: P50: 1.50 P75: 1.98 P99: 351.25 P99.9: 778.56 P99.99: 1217.46 ------------------------------------------------------ [ 0, 1 ] 54917 23.926% 23.926% ##### ( 1, 2 ] 119052 51.868% 75.794% ########## ( 2, 3 ] 13830 6.025% 81.820% # ( 3, 4 ] 3816 1.663% 83.482% ( 4, 6 ] 2399 1.045% 84.527% ( 6, 10 ] 1195 0.521% 85.048% ( 10, 15 ] 264 0.115% 85.163% ( 15, 22 ] 42 0.018% 85.181% ( 22, 34 ] 8 0.003% 85.185% ( 34, 51 ] 2 0.001% 85.186% ( 51, 76 ] 1 0.000% 85.186% ( 76, 110 ] 532 0.232% 85.418% ( 110, 170 ] 10344 4.507% 89.925% # ( 170, 250 ] 18203 7.931% 97.855% ## ( 250, 380 ] 3374 1.470% 99.325% ( 380, 580 ] 1099 0.479% 99.804% ( 580, 870 ] 322 0.140% 99.944% ( 870, 1300 ] 130 0.057% 100.001% ( 1300, 1900 ] 75 0.033% 100.034% ( 1900, 2900 ] 54 0.024% 100.057% ( 2900, 4400 ] 17 0.007% 100.064% ( 4400, 6600 ] 6 0.003% 100.067% ( 6600, 9900 ] 12 0.005% 100.072% ( 14000, 22000 ] 1 0.000% 100.073% ** Level 1 read latency histogram (micros): Count: 556 Average: 328.8579 StdDev: 827.08 Min: 100 Median: 197.1845 Max: 7361 Percentiles: P50: 197.18 P75: 233.17 P99: 5661.33 P99.9: 7361.00 P99.99: 7361.00 ------------------------------------------------------ ( 76, 110 ] 5 0.899% 0.899% ( 110, 170 ] 168 30.216% 31.115% ###### ( 170, 250 ] 309 55.576% 86.691% ########### ( 250, 380 ] 39 7.014% 93.705% # ( 380, 580 ] 17 3.058% 96.763% # ( 580, 870 ] 2 0.360% 97.122% ( 1300, 1900 ] 2 0.360% 97.482% ( 1900, 2900 ] 2 0.360% 97.842% ( 2900, 4400 ] 3 0.540% 98.381% ( 4400, 6600 ] 6 1.079% 99.460% ( 6600, 9900 ] 3 0.540% 100.000% ** Level 3 read latency histogram (micros): Count: 2784 Average: 232.7838 StdDev: 226.86 Min: 91 Median: 199.0957 Max: 3911 Percentiles: P50: 199.10 P75: 236.12 P99: 1408.00 P99.9: 2851.00 P99.99: 3911.00 ------------------------------------------------------ ( 76, 110 ] 34 1.221% 1.221% ( 110, 170 ] 811 29.131% 30.352% ###### ( 170, 250 ] 1504 54.023% 84.375% ########### ( 250, 380 ] 249 8.944% 93.319% ## ( 380, 580 ] 114 4.095% 97.414% # ( 580, 870 ] 23 0.826% 98.240% ( 870, 1300 ] 19 0.682% 98.922% ( 1300, 1900 ] 12 0.431% 99.353% ( 1900, 2900 ] 16 0.575% 99.928% ( 2900, 4400 ] 2 0.072% 100.000% ** Level 4 read latency histogram (micros): Count: 44081 Average: 121.2627 StdDev: 190.73 Min: 0 Median: 116.4056 Max: 5109 Percentiles: P50: 116.41 P75: 201.91 P99: 758.59 P99.9: 2503.94 P99.99: 3469.39 ------------------------------------------------------ [ 0, 1 ] 2151 4.880% 4.880% # ( 1, 2 ] 13112 29.745% 34.625% ###### ( 2, 3 ] 3151 7.148% 41.773% # ( 3, 4 ] 1086 2.464% 44.237% ( 4, 6 ] 954 2.164% 46.401% ( 6, 10 ] 384 0.871% 47.272% ( 10, 15 ] 95 0.216% 47.488% ( 15, 22 ] 17 0.039% 47.526% ( 22, 34 ] 5 0.011% 47.537% ( 34, 51 ] 1 0.002% 47.540% ( 51, 76 ] 1 0.002% 47.542% ( 76, 110 ] 357 0.810% 48.352% ( 110, 170 ] 6805 15.437% 63.789% ### ( 170, 250 ] 12392 28.112% 91.901% ###### ( 250, 380 ] 2189 4.966% 96.867% # ( 380, 580 ] 778 1.765% 98.632% ( 580, 870 ] 265 0.601% 99.233% ( 870, 1300 ] 152 0.345% 99.578% ( 1300, 1900 ] 94 0.213% 99.791% ( 1900, 2900 ] 81 0.184% 99.975% ( 2900, 4400 ] 20 0.045% 100.020% ( 4400, 6600 ] 2 0.005% 100.025% ** Level 5 read latency histogram (micros): Count: 24322 Average: 226.8721 StdDev: 211.14 Min: 90 Median: 198.3841 Max: 4661 Percentiles: P50: 198.38 P75: 235.55 P99: 1140.75 P99.9: 3348.86 P99.99: 4661.00 ------------------------------------------------------ ( 76, 110 ] 367 1.509% 1.509% ( 110, 170 ] 7150 29.397% 30.906% ###### ( 170, 250 ] 13089 53.815% 84.722% ########### ( 250, 380 ] 2301 9.461% 94.182% ## ( 380, 580 ] 840 3.454% 97.636% # ( 580, 870 ] 243 0.999% 98.635% ( 870, 1300 ] 141 0.580% 99.215% ( 1300, 1900 ] 85 0.349% 99.564% ( 1900, 2900 ] 73 0.300% 99.864% ( 2900, 4400 ] 29 0.119% 99.984% ( 4400, 6600 ] 3 0.012% 99.996% ** DB Stats ** Uptime(secs): 4.6 total, 4.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 215.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.677 H:M:S, 14.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 220.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.677 H:M:S, 15.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/05-12:25:48 ... thread 0: (1000000,2000000) ops and (125030.5,160416.7) ops/second in (7.998050,12.467528) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 4.76 GB 104.3 2.8 0.0 2.8 4.6 1.8 0.0 2.5 173.5 287.5 16.29 15.38 38 0.429 2869K 30K 0.0 0.0 L1 3/3 187.15 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 991.54 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 128/0 9.65 GB 1.0 0.5 0.3 0.2 0.5 0.3 0.0 1.5 165.5 163.2 2.88 2.34 3 0.959 308K 0 0.0 0.0 L5 128/0 10.52 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 294/19 26.08 GB 0.0 3.2 0.3 2.9 5.0 2.1 0.7 2.7 172.3 268.8 19.17 17.72 41 0.467 3178K 30K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 0.3 2.9 5.0 2.1 0.7 2.7 172.3 268.8 19.17 17.72 41 0.467 3178K 30K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 0.3 2.9 3.2 0.3 0.0 0.0 246.0 243.2 13.42 12.74 11 1.220 3178K 30K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 328.6 5.74 4.98 30 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.6 total, 12.5 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.03 GB write, 410.14 MB/s write, 3.22 GB read, 262.87 MB/s read, 19.2 seconds Interval compaction: 5.03 GB write, 413.14 MB/s write, 3.22 GB read, 264.79 MB/s read, 19.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 0, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 846107 Average: 27.4986 StdDev: 86.05 Min: 0 Median: 1.4953 Max: 18304 Percentiles: P50: 1.50 P75: 1.96 P99: 287.77 P99.9: 516.85 P99.99: 577.41 ------------------------------------------------------ [ 0, 1 ] 198919 23.510% 23.510% ##### ( 1, 2 ] 452546 53.486% 76.996% ########### ( 2, 3 ] 58445 6.908% 83.903% # ( 3, 4 ] 16038 1.896% 85.799% ( 4, 6 ] 9015 1.065% 86.864% ( 6, 10 ] 2808 0.332% 87.196% ( 10, 15 ] 558 0.066% 87.262% ( 15, 22 ] 98 0.012% 87.273% ( 22, 34 ] 17 0.002% 87.275% ( 34, 51 ] 7 0.001% 87.276% ( 51, 76 ] 6 0.001% 87.277% ( 76, 110 ] 1679 0.198% 87.475% ( 110, 170 ] 34783 4.111% 91.586% # ( 170, 250 ] 60315 7.129% 98.715% # ( 250, 380 ] 8308 0.982% 99.697% ( 380, 580 ] 2515 0.297% 99.994% ( 580, 870 ] 505 0.060% 100.054% ( 870, 1300 ] 140 0.017% 100.070% ( 1300, 1900 ] 82 0.010% 100.080% ( 1900, 2900 ] 57 0.007% 100.087% ( 2900, 4400 ] 21 0.002% 100.089% ( 4400, 6600 ] 6 0.001% 100.090% ( 6600, 9900 ] 12 0.001% 100.091% ( 14000, 22000 ] 1 0.000% 100.091% ** Level 1 read latency histogram (micros): Count: 1602 Average: 240.3533 StdDev: 494.15 Min: 94 Median: 192.6328 Max: 7361 Percentiles: P50: 192.63 P75: 229.63 P99: 869.03 P99.9: 7361.00 P99.99: 7361.00 ------------------------------------------------------ ( 76, 110 ] 25 1.561% 1.561% ( 110, 170 ] 531 33.146% 34.707% ####### ( 170, 250 ] 866 54.057% 88.764% ########### ( 250, 380 ] 122 7.615% 96.380% ## ( 380, 580 ] 36 2.247% 98.627% ( 580, 870 ] 6 0.375% 99.001% ( 1300, 1900 ] 2 0.125% 99.126% ( 1900, 2900 ] 2 0.125% 99.251% ( 2900, 4400 ] 3 0.187% 99.438% ( 4400, 6600 ] 6 0.375% 99.813% ( 6600, 9900 ] 3 0.187% 100.000% ** Level 3 read latency histogram (micros): Count: 8460 Average: 204.3641 StdDev: 140.93 Min: 90 Median: 191.7993 Max: 3911 Percentiles: P50: 191.80 P75: 228.48 P99: 579.46 P99.9: 2496.25 P99.99: 3765.50 ------------------------------------------------------ ( 76, 110 ] 130 1.537% 1.537% ( 110, 170 ] 2843 33.605% 35.142% ####### ( 170, 250 ] 4613 54.527% 89.669% ########### ( 250, 380 ] 568 6.714% 96.383% # ( 380, 580 ] 222 2.624% 99.007% # ( 580, 870 ] 32 0.378% 99.385% ( 870, 1300 ] 22 0.260% 99.645% ( 1300, 1900 ] 12 0.142% 99.787% ( 1900, 2900 ] 16 0.189% 99.976% ( 2900, 4400 ] 2 0.024% 100.000% ** Level 4 read latency histogram (micros): Count: 93142 Average: 155.3792 StdDev: 144.06 Min: 0 Median: 168.9541 Max: 5109 Percentiles: P50: 168.95 P75: 217.23 P99: 554.18 P99.9: 1910.46 P99.99: 3083.12 ------------------------------------------------------ [ 0, 1 ] 2151 2.309% 2.309% ( 1, 2 ] 13237 14.212% 16.521% ### ( 2, 3 ] 3603 3.868% 20.389% # ( 3, 4 ] 1337 1.435% 21.825% ( 4, 6 ] 1245 1.337% 23.161% ( 6, 10 ] 408 0.438% 23.599% ( 10, 15 ] 103 0.111% 23.710% ( 15, 22 ] 19 0.020% 23.730% ( 22, 34 ] 5 0.005% 23.736% ( 34, 51 ] 1 0.001% 23.737% ( 51, 76 ] 1 0.001% 23.738% ( 76, 110 ] 1238 1.329% 25.067% ( 110, 170 ] 23635 25.375% 50.442% ##### ( 170, 250 ] 38746 41.599% 92.041% ######## ( 250, 380 ] 5069 5.442% 97.483% # ( 380, 580 ] 1622 1.741% 99.225% ( 580, 870 ] 374 0.402% 99.626% ( 870, 1300 ] 159 0.171% 99.797% ( 1300, 1900 ] 95 0.102% 99.899% ( 1900, 2900 ] 82 0.088% 99.987% ( 2900, 4400 ] 22 0.024% 100.011% ( 4400, 6600 ] 2 0.002% 100.013% ** Level 5 read latency histogram (micros): Count: 73609 Average: 202.2733 StdDev: 132.31 Min: 89 Median: 191.8130 Max: 4661 Percentiles: P50: 191.81 P75: 228.49 P99: 576.48 P99.9: 2345.21 P99.99: 4174.44 ------------------------------------------------------ ( 76, 110 ] 1286 1.747% 1.747% ( 110, 170 ] 24573 33.383% 35.130% ####### ( 170, 250 ] 40143 54.535% 89.666% ########### ( 250, 380 ] 5247 7.128% 96.794% # ( 380, 580 ] 1653 2.246% 99.040% ( 580, 870 ] 365 0.496% 99.535% ( 870, 1300 ] 148 0.201% 99.736% ( 1300, 1900 ] 87 0.118% 99.855% ( 1900, 2900 ] 75 0.102% 99.957% ( 2900, 4400 ] 29 0.039% 99.996% ( 4400, 6600 ] 3 0.004% 100.000% ** DB Stats ** Uptime(secs): 12.6 total, 8.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 156.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.831 H:M:S, 38.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 123.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.153 H:M:S, 51.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 255.434 micros/op 15610 ops/sec 20.178 seconds 314996 operations; 15.1 MB/s (79999 of 79999 found) Microseconds per read: Count: 314996 Average: 255.4463 StdDev: 395.39 Min: 2 Median: 220.8822 Max: 39941 Percentiles: P50: 220.88 P75: 285.93 P99: 774.29 P99.9: 3559.18 P99.99: 21487.26 ------------------------------------------------------ ( 1, 2 ] 11 0.003% 0.003% ( 2, 3 ] 83 0.026% 0.030% ( 3, 4 ] 147 0.047% 0.077% ( 4, 6 ] 257 0.082% 0.158% ( 6, 10 ] 416 0.132% 0.290% ( 10, 15 ] 2434 0.773% 1.063% ( 15, 22 ] 3666 1.164% 2.227% ( 22, 34 ] 5151 1.635% 3.862% ( 34, 51 ] 1611 0.511% 4.373% ( 51, 76 ] 312 0.099% 4.472% ( 76, 110 ] 145 0.046% 4.518% ( 110, 170 ] 33215 10.545% 15.063% ## ( 170, 250 ] 173027 54.930% 69.993% ########### ( 250, 380 ] 57059 18.114% 88.107% #### ( 380, 580 ] 30195 9.586% 97.693% ## ( 580, 870 ] 6145 1.951% 99.644% ( 870, 1300 ] 652 0.207% 99.851% ( 1300, 1900 ] 68 0.022% 99.872% ( 1900, 2900 ] 58 0.018% 99.891% ( 2900, 4400 ] 66 0.021% 99.912% ( 4400, 6600 ] 83 0.026% 99.938% ( 6600, 9900 ] 101 0.032% 99.970% ( 9900, 14000 ] 26 0.008% 99.978% ( 14000, 22000 ] 39 0.012% 99.991% ( 22000, 33000 ] 28 0.009% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 5633788 rocksdb.bloom.filter.full.positive COUNT : 368894 rocksdb.bloom.filter.full.true.positive COUNT : 313929 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 1067 rocksdb.memtable.miss COUNT : 313929 rocksdb.l0.hit COUNT : 66454 rocksdb.l1.hit COUNT : 2368 rocksdb.l2andup.hit COUNT : 245107 rocksdb.compaction.key.drop.new COUNT : 76144 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 2943215 rocksdb.number.keys.read COUNT : 314996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3037397880 rocksdb.bytes.read COUNT : 314996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 354 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 8984697 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 5730660283 rocksdb.compact.write.bytes COUNT : 5649194175 rocksdb.flush.write.bytes COUNT : 2968688248 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 17 rocksdb.number.superversion_acquires COUNT : 450 rocksdb.number.superversion_releases COUNT : 426 rocksdb.number.superversion_cleanups COUNT : 107 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 2948626432 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4677632 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 7014186760 rocksdb.non.last.level.read.count COUNT : 1660718 rocksdb.block.checksum.compute.count COUNT : 1761158 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 220.281352 P95 : 523.136823 P99 : 773.461737 P100 : 39939.000000 COUNT : 314996 SUM : 80175703 rocksdb.db.write.micros P50 : 1.486901 P95 : 5.106975 P99 : 9.475196 P100 : 5115.000000 COUNT : 2943215 SUM : 16499807 rocksdb.compaction.times.micros P50 : 1044166.666667 P95 : 3775000.000000 P99 : 3879273.000000 P100 : 3879273.000000 COUNT : 15 SUM : 19363213 rocksdb.compaction.times.cpu_micros P50 : 1044166.666667 P95 : 3775000.000000 P99 : 3834968.000000 P100 : 3834968.000000 COUNT : 15 SUM : 18566932 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 546.666667 P95 : 1474.000000 P99 : 1474.000000 P100 : 1474.000000 COUNT : 45 SUM : 32308 rocksdb.compaction.outfile.sync.micros P50 : 969.230769 P95 : 2300.000000 P99 : 2422.000000 P100 : 2422.000000 COUNT : 24 SUM : 24489 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 165.161290 P95 : 550.000000 P99 : 1958.000000 P100 : 1958.000000 COUNT : 63 SUM : 15491 rocksdb.table.open.io.micros P50 : 4769.747899 P95 : 9862.131148 P99 : 27169.000000 P100 : 27169.000000 COUNT : 354 SUM : 1827589 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.490459 P95 : 153.016113 P99 : 244.202233 P100 : 3814.000000 COUNT : 1388345 SUM : 23524607 rocksdb.read.block.get.micros P50 : 191.075279 P95 : 332.225514 P99 : 530.058003 P100 : 19751.000000 COUNT : 372692 SUM : 69946831 rocksdb.write.raw.block.micros P50 : 0.524045 P95 : 0.995685 P99 : 3.859818 P100 : 5628.000000 COUNT : 2088305 SUM : 4500361 rocksdb.numfiles.in.singlecompaction P50 : 3.464286 P95 : 10.250000 P99 : 14.050000 P100 : 15.000000 COUNT : 19 SUM : 84 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560160 P95 : 1122.646661 P99 : 1946.859396 P100 : 2181.000000 COUNT : 72534 SUM : 8990917 rocksdb.sst.read.micros P50 : 1.668540 P95 : 235.843436 P99 : 357.239043 P100 : 18304.000000 COUNT : 1661001 SUM : 88020153 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 314996 SUM : 314996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 2943215 SUM : 3037397880 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211860.465116 P95 : 249534.883721 P99 : 270342.000000 P100 : 270342.000000 COUNT : 45 SUM : 8627510 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 57 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0