[2024-11-04 15:33:45.020214] Starting SPDK v25.01-pre git sha1 f220d590c / DPDK 24.03.0 initialization... [2024-11-04 15:33:45.020328] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1946556 ] Set seed to 1730730825017655 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-04 15:33:45.155902] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-04 15:33:45.257222] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-04 15:33:45.257275] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1946556' to capture a snapshot of events at runtime. [2024-11-04 15:33:45.257288] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-04 15:33:45.257301] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-04 15:33:45.257310] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1946556 for offline analysis/debug. [2024-11-04 15:33:45.258573] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Nov 4 15:33:48 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/04-15:33:55 ... thread 0: (1000000,1000000) ops and (143482.4,143482.4) ops/second in (6.969497,6.969497) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 817.18 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 129.8 6.30 2.53 10 0.630 0 0 0.0 0.0 L1 3/3 165.81 MB 0.0 0.3 0.2 0.0 0.3 0.2 0.0 1.2 119.0 118.4 2.27 1.36 1 2.270 274K 1428 0.0 0.0 L2 2/0 102.94 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 98.7 98.7 1.04 0.55 1 1.043 104K 0 0.0 0.0 L3 36/8 1.88 GB 1.5 2.7 1.9 0.9 2.6 1.8 0.0 1.4 107.9 103.8 25.98 14.29 13 1.999 2061K 11K 0.0 0.0 L4 165/24 11.82 GB 1.0 3.0 1.8 1.2 2.9 1.7 0.5 1.6 118.9 114.2 26.18 16.13 14 1.870 847K 178 0.0 0.0 L5 120/0 9.35 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 336/43 24.11 GB 0.0 6.1 4.0 2.1 6.7 4.6 0.5 8.4 101.8 111.3 61.77 34.87 39 1.584 3288K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 4.0 2.1 6.7 4.6 0.5 8.4 101.8 111.3 61.77 34.87 39 1.584 3288K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 4.0 2.1 5.9 3.8 0.0 0.0 113.4 109.2 55.47 32.34 29 1.913 3288K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 129.8 6.30 2.53 10 0.630 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.0 total, 7.0 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.72 GB write, 975.68 MB/s write, 6.14 GB read, 892.46 MB/s read, 61.8 seconds Interval compaction: 6.72 GB write, 986.20 MB/s write, 6.14 GB read, 902.08 MB/s read, 61.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 64461 Average: 97.0787 StdDev: 651.32 Min: 1 Median: 2.3063 Max: 44323 Percentiles: P50: 2.31 P75: 3.74 P99: 2219.45 P99.9: 6151.91 P99.99: 28553.90 ------------------------------------------------------ [ 0, 1 ] 1140 1.769% 1.769% ( 1, 2 ] 25952 40.260% 42.029% ######## ( 2, 3 ] 16776 26.025% 68.054% ##### ( 3, 4 ] 6013 9.328% 77.382% ## ( 4, 6 ] 6770 10.502% 87.884% ## ( 6, 10 ] 1784 2.768% 90.652% # ( 10, 15 ] 483 0.749% 91.401% ( 15, 22 ] 75 0.116% 91.517% ( 22, 34 ] 10 0.016% 91.533% ( 34, 51 ] 12 0.019% 91.551% ( 51, 76 ] 6 0.009% 91.561% ( 76, 110 ] 2 0.003% 91.564% ( 110, 170 ] 33 0.051% 91.615% ( 170, 250 ] 202 0.313% 91.928% ( 250, 380 ] 629 0.976% 92.904% ( 380, 580 ] 1412 2.190% 95.095% ( 580, 870 ] 1514 2.349% 97.443% ( 870, 1300 ] 724 1.123% 98.567% ( 1300, 1900 ] 204 0.316% 98.883% ( 1900, 2900 ] 236 0.366% 99.249% ( 2900, 4400 ] 363 0.563% 99.812% ( 4400, 6600 ] 71 0.110% 99.922% ( 6600, 9900 ] 30 0.047% 99.969% ( 9900, 14000 ] 2 0.003% 99.972% ( 14000, 22000 ] 5 0.008% 99.980% ( 22000, 33000 ] 11 0.017% 99.997% ( 33000, 50000 ] 4 0.006% 100.003% ** Level 1 read latency histogram (micros): Count: 37148 Average: 23.1446 StdDev: 388.14 Min: 1 Median: 2.3614 Max: 43382 Percentiles: P50: 2.36 P75: 3.38 P99: 459.88 P99.9: 3957.88 P99.99: 9113.72 ------------------------------------------------------ [ 0, 1 ] 193 0.520% 0.520% ( 1, 2 ] 14043 37.803% 38.322% ######## ( 2, 3 ] 12003 32.311% 70.634% ###### ( 3, 4 ] 4221 11.363% 81.996% ## ( 4, 6 ] 4712 12.684% 94.681% ### ( 6, 10 ] 1156 3.112% 97.793% # ( 10, 15 ] 251 0.676% 98.468% ( 15, 22 ] 28 0.075% 98.544% ( 22, 34 ] 6 0.016% 98.560% ( 34, 51 ] 18 0.048% 98.608% ( 51, 76 ] 8 0.022% 98.630% ( 76, 110 ] 4 0.011% 98.641% ( 110, 170 ] 6 0.016% 98.657% ( 170, 250 ] 23 0.062% 98.719% ( 250, 380 ] 53 0.143% 98.861% ( 380, 580 ] 129 0.347% 99.209% ( 580, 870 ] 115 0.310% 99.518% ( 870, 1300 ] 47 0.127% 99.645% ( 1300, 1900 ] 30 0.081% 99.725% ( 1900, 2900 ] 31 0.083% 99.809% ( 2900, 4400 ] 48 0.129% 99.938% ( 4400, 6600 ] 17 0.046% 99.984% ( 6600, 9900 ] 3 0.008% 99.992% ( 9900, 14000 ] 1 0.003% 99.995% ( 22000, 33000 ] 2 0.005% 100.000% ( 33000, 50000 ] 1 0.003% 100.003% ** Level 2 read latency histogram (micros): Count: 400745 Average: 15.2410 StdDev: 261.93 Min: 1 Median: 2.2986 Max: 43989 Percentiles: P50: 2.30 P75: 3.32 P99: 13.59 P99.9: 1519.97 P99.99: 2706.08 ------------------------------------------------------ [ 0, 1 ] 3349 0.836% 0.836% ( 1, 2 ] 160584 40.071% 40.907% ######## ( 2, 3 ] 122034 30.452% 71.359% ###### ( 3, 4 ] 45116 11.258% 82.617% ## ( 4, 6 ] 50545 12.613% 95.230% ### ( 6, 10 ] 12643 3.155% 98.385% # ( 10, 15 ] 3434 0.857% 99.241% ( 15, 22 ] 569 0.142% 99.383% ( 22, 34 ] 95 0.024% 99.407% ( 34, 51 ] 116 0.029% 99.436% ( 51, 76 ] 96 0.024% 99.460% ( 76, 110 ] 23 0.006% 99.466% ( 110, 170 ] 35 0.009% 99.474% ( 170, 250 ] 84 0.021% 99.495% ( 250, 380 ] 276 0.069% 99.564% ( 380, 580 ] 514 0.128% 99.693% ( 580, 870 ] 482 0.120% 99.813% ( 870, 1300 ] 273 0.068% 99.881% ( 1300, 1900 ] 208 0.052% 99.933% ( 1900, 2900 ] 284 0.071% 100.004% ( 2900, 4400 ] 378 0.094% 100.098% ( 4400, 6600 ] 122 0.030% 100.129% ( 6600, 9900 ] 29 0.007% 100.136% ( 9900, 14000 ] 8 0.002% 100.138% ( 14000, 22000 ] 11 0.003% 100.140% ( 22000, 33000 ] 11 0.003% 100.143% ( 33000, 50000 ] 2 0.000% 100.144% ** Level 3 read latency histogram (micros): Count: 678230 Average: 18.2406 StdDev: 306.80 Min: 1 Median: 2.3358 Max: 48191 Percentiles: P50: 2.34 P75: 3.33 P99: 15.61 P99.9: 1153.92 P99.99: 1795.79 ------------------------------------------------------ [ 0, 1 ] 4707 0.694% 0.694% ( 1, 2 ] 261463 38.551% 39.245% ######## ( 2, 3 ] 217215 32.027% 71.272% ###### ( 3, 4 ] 76924 11.342% 82.613% ## ( 4, 6 ] 86027 12.684% 95.297% ### ( 6, 10 ] 20602 3.038% 98.335% # ( 10, 15 ] 4452 0.656% 98.991% ( 15, 22 ] 662 0.098% 99.089% ( 22, 34 ] 140 0.021% 99.110% ( 34, 51 ] 273 0.040% 99.150% ( 51, 76 ] 189 0.028% 99.178% ( 76, 110 ] 61 0.009% 99.187% ( 110, 170 ] 77 0.011% 99.198% ( 170, 250 ] 252 0.037% 99.235% ( 250, 380 ] 756 0.111% 99.347% ( 380, 580 ] 1629 0.240% 99.587% ( 580, 870 ] 1582 0.233% 99.820% ( 870, 1300 ] 819 0.121% 99.941% ( 1300, 1900 ] 402 0.059% 100.000% ( 1900, 2900 ] 484 0.071% 100.072% ( 2900, 4400 ] 615 0.091% 100.162% ( 4400, 6600 ] 175 0.026% 100.188% ( 6600, 9900 ] 77 0.011% 100.199% ( 9900, 14000 ] 20 0.003% 100.202% ( 14000, 22000 ] 38 0.006% 100.208% ( 22000, 33000 ] 16 0.002% 100.210% ( 33000, 50000 ] 10 0.001% 100.212% ** Level 4 read latency histogram (micros): Count: 558910 Average: 30.5731 StdDev: 373.68 Min: 1 Median: 2.3659 Max: 51858 Percentiles: P50: 2.37 P75: 3.46 P99: 583.15 P99.9: 1926.55 P99.99: 2626.16 ------------------------------------------------------ [ 0, 1 ] 4675 0.836% 0.836% ( 1, 2 ] 211322 37.810% 38.646% ######## ( 2, 3 ] 173436 31.031% 69.677% ###### ( 3, 4 ] 65038 11.637% 81.314% ## ( 4, 6 ] 72708 13.009% 94.323% ### ( 6, 10 ] 16458 2.945% 97.267% # ( 10, 15 ] 3541 0.634% 97.901% ( 15, 22 ] 523 0.094% 97.994% ( 22, 34 ] 115 0.021% 98.015% ( 34, 51 ] 227 0.041% 98.056% ( 51, 76 ] 163 0.029% 98.085% ( 76, 110 ] 32 0.006% 98.091% ( 110, 170 ] 112 0.020% 98.111% ( 170, 250 ] 486 0.087% 98.198% ( 250, 380 ] 1389 0.249% 98.446% ( 380, 580 ] 3064 0.548% 98.994% ( 580, 870 ] 3025 0.541% 99.536% ( 870, 1300 ] 1440 0.258% 99.793% ( 1300, 1900 ] 579 0.104% 99.897% ( 1900, 2900 ] 719 0.129% 100.025% ( 2900, 4400 ] 980 0.175% 100.201% ( 4400, 6600 ] 238 0.043% 100.243% ( 6600, 9900 ] 98 0.018% 100.261% ( 9900, 14000 ] 20 0.004% 100.264% ( 14000, 22000 ] 26 0.005% 100.269% ( 22000, 33000 ] 16 0.003% 100.272% ( 33000, 50000 ] 12 0.002% 100.274% ( 50000, 75000 ] 1 0.000% 100.274% ** Level 5 read latency histogram (micros): Count: 8460 Average: 1150.4567 StdDev: 2093.50 Min: 107 Median: 653.5343 Max: 47067 Percentiles: P50: 653.53 P75: 1084.56 P99: 6392.50 P99.9: 39727.14 P99.99: 47067.00 ------------------------------------------------------ ( 76, 110 ] 2 0.024% 0.024% ( 110, 170 ] 64 0.757% 0.780% ( 170, 250 ] 334 3.948% 4.728% # ( 250, 380 ] 1008 11.915% 16.643% ## ( 380, 580 ] 2271 26.844% 43.487% ##### ( 580, 870 ] 2173 25.686% 69.173% ##### ( 870, 1300 ] 988 11.678% 80.851% ## ( 1300, 1900 ] 367 4.338% 85.189% # ( 1900, 2900 ] 420 4.965% 90.154% # ( 2900, 4400 ] 589 6.962% 97.116% # ( 4400, 6600 ] 176 2.080% 99.196% ( 6600, 9900 ] 40 0.473% 99.669% ( 9900, 14000 ] 4 0.047% 99.716% ( 14000, 22000 ] 4 0.047% 99.764% ( 22000, 33000 ] 6 0.071% 99.835% ( 33000, 50000 ] 14 0.165% 100.000% ** DB Stats ** Uptime(secs): 7.0 total, 7.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 139.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.237 H:M:S, 31.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 141.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.237 H:M:S, 32.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/04-15:34:00 ... thread 0: (1000000,2000000) ops and (174821.3,157609.1) ops/second in (5.720128,12.689625) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 1.84 GB 131.4 0.9 0.0 0.9 2.8 1.8 0.0 1.5 41.6 124.7 22.65 10.11 27 0.839 957K 5577 0.0 0.0 L1 3/3 165.81 MB 0.0 0.3 0.2 0.0 0.3 0.2 0.0 1.2 119.0 118.4 2.27 1.36 1 2.270 274K 1428 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 98.7 98.7 1.04 0.55 1 1.043 104K 0 0.0 0.0 L3 18/0 980.76 MB 1.0 2.7 1.9 0.9 2.6 1.8 0.1 1.4 107.9 103.8 25.98 14.29 13 1.999 2061K 11K 0.0 0.0 L4 148/0 9.73 GB 1.0 8.9 2.9 6.1 7.8 1.7 0.5 2.7 139.3 121.6 65.60 42.26 34 1.930 1910K 178 0.0 0.0 L5 152/0 11.45 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 336/11 24.13 GB 0.0 12.9 5.1 7.9 13.5 5.7 2.7 7.4 112.8 118.0 117.55 68.58 76 1.547 5309K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.9 5.1 7.9 13.5 5.7 2.7 7.4 112.8 118.0 117.55 68.58 76 1.547 5309K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.9 5.1 7.9 11.7 3.8 0.0 0.0 125.5 113.4 105.64 62.91 52 2.031 5309K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 158.4 11.91 5.67 24 0.496 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.8 total, 12.7 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.54 GB write, 1086.17 MB/s write, 12.95 GB read, 1038.23 MB/s read, 117.5 seconds Interval compaction: 13.54 GB write, 1092.60 MB/s write, 12.95 GB read, 1044.38 MB/s read, 117.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 31, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 412412 Average: 50.4244 StdDev: 452.63 Min: 1 Median: 1.9595 Max: 62418 Percentiles: P50: 1.96 P75: 2.94 P99: 979.56 P99.9: 3580.89 P99.99: 4158.44 ------------------------------------------------------ [ 0, 1 ] 15669 3.799% 3.799% # ( 1, 2 ] 198573 48.149% 51.949% ########## ( 2, 3 ] 101289 24.560% 76.509% ##### ( 3, 4 ] 33014 8.005% 84.514% ## ( 4, 6 ] 30938 7.502% 92.016% ## ( 6, 10 ] 9294 2.254% 94.269% ( 10, 15 ] 1814 0.440% 94.709% ( 15, 22 ] 253 0.061% 94.770% ( 22, 34 ] 21 0.005% 94.775% ( 34, 51 ] 35 0.008% 94.784% ( 51, 76 ] 14 0.003% 94.787% ( 76, 110 ] 37 0.009% 94.796% ( 110, 170 ] 859 0.208% 95.005% ( 170, 250 ] 2644 0.641% 95.646% ( 250, 380 ] 2934 0.711% 96.357% ( 380, 580 ] 5038 1.222% 97.579% ( 580, 870 ] 5216 1.265% 98.843% ( 870, 1300 ] 2535 0.615% 99.458% ( 1300, 1900 ] 680 0.165% 99.623% ( 1900, 2900 ] 705 0.171% 99.794% ( 2900, 4400 ] 964 0.234% 100.028% ( 4400, 6600 ] 196 0.048% 100.075% ( 6600, 9900 ] 51 0.012% 100.088% ( 9900, 14000 ] 9 0.002% 100.090% ( 14000, 22000 ] 30 0.007% 100.097% ( 22000, 33000 ] 25 0.006% 100.103% ( 33000, 50000 ] 13 0.003% 100.106% ( 50000, 75000 ] 1 0.000% 100.106% ** Level 1 read latency histogram (micros): Count: 54824 Average: 21.7295 StdDev: 338.69 Min: 1 Median: 2.2677 Max: 43382 Percentiles: P50: 2.27 P75: 3.22 P99: 469.26 P99.9: 3613.89 P99.99: 9369.36 ------------------------------------------------------ [ 0, 1 ] 445 0.812% 0.812% ( 1, 2 ] 22427 40.907% 41.719% ######## ( 2, 3 ] 16959 30.934% 72.652% ###### ( 3, 4 ] 5790 10.561% 83.214% ## ( 4, 6 ] 6147 11.212% 94.426% ## ( 6, 10 ] 1632 2.977% 97.403% # ( 10, 15 ] 339 0.618% 98.021% ( 15, 22 ] 46 0.084% 98.105% ( 22, 34 ] 10 0.018% 98.123% ( 34, 51 ] 18 0.033% 98.156% ( 51, 76 ] 8 0.015% 98.171% ( 76, 110 ] 5 0.009% 98.180% ( 110, 170 ] 53 0.097% 98.276% ( 170, 250 ] 155 0.283% 98.559% ( 250, 380 ] 140 0.255% 98.814% ( 380, 580 ] 228 0.416% 99.230% ( 580, 870 ] 191 0.348% 99.579% ( 870, 1300 ] 72 0.131% 99.710% ( 1300, 1900 ] 35 0.064% 99.774% ( 1900, 2900 ] 43 0.078% 99.852% ( 2900, 4400 ] 55 0.100% 99.953% ( 4400, 6600 ] 18 0.033% 99.985% ( 6600, 9900 ] 3 0.005% 99.991% ( 9900, 14000 ] 2 0.004% 99.995% ( 14000, 22000 ] 1 0.002% 99.996% ( 22000, 33000 ] 2 0.004% 100.000% ( 33000, 50000 ] 1 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 401027 Average: 15.8588 StdDev: 281.54 Min: 1 Median: 2.2998 Max: 58818 Percentiles: P50: 2.30 P75: 3.33 P99: 14.00 P99.9: 1567.53 P99.99: 2743.39 ------------------------------------------------------ [ 0, 1 ] 3349 0.835% 0.835% ( 1, 2 ] 160584 40.043% 40.878% ######## ( 2, 3 ] 122034 30.430% 71.309% ###### ( 3, 4 ] 45116 11.250% 82.559% ## ( 4, 6 ] 50545 12.604% 95.163% ### ( 6, 10 ] 12643 3.153% 98.315% # ( 10, 15 ] 3434 0.856% 99.172% ( 15, 22 ] 569 0.142% 99.314% ( 22, 34 ] 95 0.024% 99.337% ( 34, 51 ] 116 0.029% 99.366% ( 51, 76 ] 96 0.024% 99.390% ( 76, 110 ] 23 0.006% 99.396% ( 110, 170 ] 55 0.014% 99.410% ( 170, 250 ] 135 0.034% 99.443% ( 250, 380 ] 330 0.082% 99.525% ( 380, 580 ] 581 0.145% 99.670% ( 580, 870 ] 526 0.131% 99.802% ( 870, 1300 ] 300 0.075% 99.876% ( 1300, 1900 ] 213 0.053% 99.929% ( 1900, 2900 ] 288 0.072% 100.001% ( 2900, 4400 ] 385 0.096% 100.097% ( 4400, 6600 ] 123 0.031% 100.128% ( 6600, 9900 ] 29 0.007% 100.135% ( 9900, 14000 ] 8 0.002% 100.137% ( 14000, 22000 ] 11 0.003% 100.140% ( 22000, 33000 ] 12 0.003% 100.143% ( 33000, 50000 ] 2 0.000% 100.143% ( 50000, 75000 ] 1 0.000% 100.144% ** Level 3 read latency histogram (micros): Count: 893333 Average: 18.2940 StdDev: 302.24 Min: 1 Median: 2.3441 Max: 62400 Percentiles: P50: 2.34 P75: 3.37 P99: 112.27 P99.9: 1220.76 P99.99: 2003.97 ------------------------------------------------------ [ 0, 1 ] 6723 0.753% 0.753% ( 1, 2 ] 342670 38.359% 39.111% ######## ( 2, 3 ] 282652 31.640% 70.751% ###### ( 3, 4 ] 102833 11.511% 82.262% ## ( 4, 6 ] 114502 12.817% 95.080% ### ( 6, 10 ] 27450 3.073% 98.153% # ( 10, 15 ] 5857 0.656% 98.808% ( 15, 22 ] 865 0.097% 98.905% ( 22, 34 ] 166 0.019% 98.924% ( 34, 51 ] 330 0.037% 98.961% ( 51, 76 ] 254 0.028% 98.989% ( 76, 110 ] 88 0.010% 98.999% ( 110, 170 ] 256 0.029% 99.028% ( 170, 250 ] 718 0.080% 99.108% ( 250, 380 ] 1282 0.144% 99.251% ( 380, 580 ] 2492 0.279% 99.530% ( 580, 870 ] 2344 0.262% 99.793% ( 870, 1300 ] 1174 0.131% 99.924% ( 1300, 1900 ] 523 0.059% 99.983% ( 1900, 2900 ] 622 0.070% 100.052% ( 2900, 4400 ] 766 0.086% 100.138% ( 4400, 6600 ] 193 0.022% 100.160% ( 6600, 9900 ] 80 0.009% 100.169% ( 9900, 14000 ] 26 0.003% 100.172% ( 14000, 22000 ] 46 0.005% 100.177% ( 22000, 33000 ] 24 0.003% 100.179% ( 33000, 50000 ] 10 0.001% 100.181% ( 50000, 75000 ] 1 0.000% 100.181% ** Level 4 read latency histogram (micros): Count: 1588843 Average: 22.4711 StdDev: 305.76 Min: 1 Median: 2.3696 Max: 53028 Percentiles: P50: 2.37 P75: 3.47 P99: 378.61 P99.9: 1083.93 P99.99: 1293.00 ------------------------------------------------------ [ 0, 1 ] 12858 0.809% 0.809% ( 1, 2 ] 601651 37.867% 38.677% ######## ( 2, 3 ] 486727 30.634% 69.311% ###### ( 3, 4 ] 191622 12.060% 81.371% ## ( 4, 6 ] 208689 13.135% 94.506% ### ( 6, 10 ] 48384 3.045% 97.551% # ( 10, 15 ] 10658 0.671% 98.222% ( 15, 22 ] 1540 0.097% 98.319% ( 22, 34 ] 267 0.017% 98.335% ( 34, 51 ] 582 0.037% 98.372% ( 51, 76 ] 424 0.027% 98.399% ( 76, 110 ] 163 0.010% 98.409% ( 110, 170 ] 1260 0.079% 98.488% ( 170, 250 ] 3924 0.247% 98.735% ( 250, 380 ] 4251 0.268% 99.003% ( 380, 580 ] 6628 0.417% 99.420% ( 580, 870 ] 6163 0.388% 99.808% ( 870, 1300 ] 2941 0.185% 99.993% ( 1300, 1900 ] 1143 0.072% 100.065% ( 1900, 2900 ] 1440 0.091% 100.156% ( 2900, 4400 ] 1648 0.104% 100.259% ( 4400, 6600 ] 389 0.024% 100.284% ( 6600, 9900 ] 153 0.010% 100.293% ( 9900, 14000 ] 45 0.003% 100.296% ( 14000, 22000 ] 81 0.005% 100.301% ( 22000, 33000 ] 38 0.002% 100.304% ( 33000, 50000 ] 17 0.001% 100.305% ( 50000, 75000 ] 2 0.000% 100.305% ** Level 5 read latency histogram (micros): Count: 18889 Average: 880.5660 StdDev: 1862.01 Min: 93 Median: 517.2443 Max: 60980 Percentiles: P50: 517.24 P75: 830.31 P99: 5736.79 P99.9: 36777.70 P99.99: 49342.99 ------------------------------------------------------ ( 76, 110 ] 31 0.164% 0.164% ( 110, 170 ] 870 4.606% 4.770% # ( 170, 250 ] 2802 14.834% 19.604% ### ( 250, 380 ] 2823 14.945% 34.549% ### ( 380, 580 ] 4253 22.516% 57.065% ##### ( 580, 870 ] 3925 20.779% 77.844% #### ( 870, 1300 ] 1780 9.423% 87.268% ## ( 1300, 1900 ] 599 3.171% 90.439% # ( 1900, 2900 ] 626 3.314% 93.753% # ( 2900, 4400 ] 855 4.526% 98.279% # ( 4400, 6600 ] 224 1.186% 99.465% ( 6600, 9900 ] 54 0.286% 99.751% ( 9900, 14000 ] 9 0.048% 99.799% ( 14000, 22000 ] 7 0.037% 99.836% ( 22000, 33000 ] 7 0.037% 99.873% ( 33000, 50000 ] 23 0.122% 99.995% ( 50000, 75000 ] 1 0.005% 100.000% ** DB Stats ** Uptime(secs): 12.8 total, 5.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 154.16 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.792 H:M:S, 29.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 172.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.555 H:M:S, 27.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/04-15:34:04 ... thread 0: (1000000,3000000) ops and (272528.1,183385.6) ops/second in (3.669346,16.358971) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/8 2.81 GB 231.6 1.9 0.0 1.9 4.7 2.8 0.0 1.7 65.8 162.9 29.65 16.69 47 0.631 1979K 10K 0.0 0.0 L1 3/3 165.81 MB 0.0 0.3 0.2 0.0 0.3 0.2 0.0 1.2 119.0 118.4 2.27 1.36 1 2.270 274K 1428 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 98.7 98.7 1.04 0.55 1 1.043 104K 0 0.0 0.0 L3 18/0 980.76 MB 1.0 2.7 1.9 0.9 2.6 1.8 0.1 1.4 107.9 103.8 25.98 14.29 13 1.999 2061K 11K 0.0 0.0 L4 148/0 9.73 GB 1.0 8.9 2.9 6.1 7.8 1.7 0.5 2.7 139.3 121.6 65.60 42.26 34 1.930 1910K 178 0.0 0.0 L5 152/0 11.45 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 340/11 25.11 GB 0.0 13.9 5.1 8.9 15.5 6.6 2.7 5.5 114.5 127.5 124.55 75.16 96 1.297 6331K 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.9 5.1 8.9 15.5 6.6 2.7 5.5 114.5 127.5 124.55 75.16 96 1.297 6331K 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.9 5.1 8.9 12.7 3.8 0.0 0.0 130.1 118.5 109.59 66.79 56 1.957 6331K 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 193.4 14.95 8.36 40 0.374 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.4 total, 16.4 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.50 GB write, 965.88 MB/s write, 13.93 GB read, 867.70 MB/s read, 124.5 seconds Interval compaction: 15.50 GB write, 970.31 MB/s write, 13.93 GB read, 871.69 MB/s read, 124.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 31, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 687133 Average: 38.0729 StdDev: 353.09 Min: 1 Median: 1.7624 Max: 62418 Percentiles: P50: 1.76 P75: 2.70 P99: 745.58 P99.9: 2860.15 P99.99: 3818.50 ------------------------------------------------------ [ 0, 1 ] 73414 10.684% 10.684% ## ( 1, 2 ] 354339 51.568% 62.252% ########## ( 2, 3 ] 125638 18.284% 80.536% #### ( 3, 4 ] 40463 5.889% 86.425% # ( 4, 6 ] 35181 5.120% 91.545% # ( 6, 10 ] 10394 1.513% 93.058% ( 10, 15 ] 2096 0.305% 93.363% ( 15, 22 ] 290 0.042% 93.405% ( 22, 34 ] 48 0.007% 93.412% ( 34, 51 ] 37 0.005% 93.417% ( 51, 76 ] 14 0.002% 93.419% ( 76, 110 ] 373 0.054% 93.473% ( 110, 170 ] 7868 1.145% 94.619% ( 170, 250 ] 16057 2.337% 96.955% ( 250, 380 ] 5250 0.764% 97.719% ( 380, 580 ] 5761 0.838% 98.558% ( 580, 870 ] 5322 0.775% 99.332% ( 870, 1300 ] 2543 0.370% 99.702% ( 1300, 1900 ] 680 0.099% 99.801% ( 1900, 2900 ] 706 0.103% 99.904% ( 2900, 4400 ] 964 0.140% 100.044% ( 4400, 6600 ] 196 0.029% 100.073% ( 6600, 9900 ] 51 0.007% 100.080% ( 9900, 14000 ] 9 0.001% 100.082% ( 14000, 22000 ] 30 0.004% 100.086% ( 22000, 33000 ] 25 0.004% 100.090% ( 33000, 50000 ] 13 0.002% 100.092% ( 50000, 75000 ] 1 0.000% 100.092% ** Level 1 read latency histogram (micros): Count: 67712 Average: 20.3193 StdDev: 305.45 Min: 1 Median: 2.3806 Max: 43382 Percentiles: P50: 2.38 P75: 3.56 P99: 376.21 P99.9: 3235.13 P99.99: 6851.68 ------------------------------------------------------ [ 0, 1 ] 619 0.914% 0.914% ( 1, 2 ] 25633 37.856% 38.770% ######## ( 2, 3 ] 19981 29.509% 68.279% ###### ( 3, 4 ] 8172 12.069% 80.348% ## ( 4, 6 ] 8817 13.021% 93.369% ### ( 6, 10 ] 2062 3.045% 96.414% # ( 10, 15 ] 522 0.771% 97.185% ( 15, 22 ] 168 0.248% 97.433% ( 22, 34 ] 30 0.044% 97.478% ( 34, 51 ] 20 0.030% 97.507% ( 51, 76 ] 11 0.016% 97.523% ( 76, 110 ] 11 0.016% 97.540% ( 110, 170 ] 243 0.359% 97.898% ( 170, 250 ] 542 0.800% 98.699% ( 250, 380 ] 210 0.310% 99.009% ( 380, 580 ] 249 0.368% 99.377% ( 580, 870 ] 192 0.284% 99.660% ( 870, 1300 ] 72 0.106% 99.767% ( 1300, 1900 ] 35 0.052% 99.818% ( 1900, 2900 ] 43 0.064% 99.882% ( 2900, 4400 ] 55 0.081% 99.963% ( 4400, 6600 ] 18 0.027% 99.990% ( 6600, 9900 ] 3 0.004% 99.994% ( 9900, 14000 ] 2 0.003% 99.997% ( 14000, 22000 ] 1 0.001% 99.999% ( 22000, 33000 ] 2 0.003% 100.001% ( 33000, 50000 ] 1 0.001% 100.003% ** Level 2 read latency histogram (micros): Count: 401507 Average: 16.0759 StdDev: 281.45 Min: 1 Median: 2.3017 Max: 58818 Percentiles: P50: 2.30 P75: 3.34 P99: 14.69 P99.9: 1566.18 P99.99: 2743.23 ------------------------------------------------------ [ 0, 1 ] 3349 0.834% 0.834% ( 1, 2 ] 160584 39.995% 40.829% ######## ( 2, 3 ] 122034 30.394% 71.223% ###### ( 3, 4 ] 45116 11.237% 82.460% ## ( 4, 6 ] 50545 12.589% 95.049% ### ( 6, 10 ] 12643 3.149% 98.198% # ( 10, 15 ] 3434 0.855% 99.053% ( 15, 22 ] 569 0.142% 99.195% ( 22, 34 ] 95 0.024% 99.218% ( 34, 51 ] 116 0.029% 99.247% ( 51, 76 ] 96 0.024% 99.271% ( 76, 110 ] 27 0.007% 99.278% ( 110, 170 ] 201 0.050% 99.328% ( 170, 250 ] 406 0.101% 99.429% ( 250, 380 ] 381 0.095% 99.524% ( 380, 580 ] 588 0.146% 99.670% ( 580, 870 ] 527 0.131% 99.802% ( 870, 1300 ] 300 0.075% 99.876% ( 1300, 1900 ] 213 0.053% 99.930% ( 1900, 2900 ] 288 0.072% 100.001% ( 2900, 4400 ] 385 0.096% 100.097% ( 4400, 6600 ] 123 0.031% 100.128% ( 6600, 9900 ] 29 0.007% 100.135% ( 9900, 14000 ] 8 0.002% 100.137% ( 14000, 22000 ] 11 0.003% 100.140% ( 22000, 33000 ] 12 0.003% 100.143% ( 33000, 50000 ] 2 0.000% 100.143% ( 50000, 75000 ] 1 0.000% 100.143% ** Level 3 read latency histogram (micros): Count: 896751 Average: 18.9948 StdDev: 301.90 Min: 1 Median: 2.3502 Max: 62400 Percentiles: P50: 2.35 P75: 3.39 P99: 233.01 P99.9: 1219.51 P99.99: 2003.42 ------------------------------------------------------ [ 0, 1 ] 6723 0.750% 0.750% ( 1, 2 ] 342670 38.212% 38.962% ######## ( 2, 3 ] 282652 31.520% 70.482% ###### ( 3, 4 ] 102833 11.467% 81.949% ## ( 4, 6 ] 114502 12.769% 94.717% ### ( 6, 10 ] 27450 3.061% 97.779% # ( 10, 15 ] 5857 0.653% 98.432% ( 15, 22 ] 865 0.096% 98.528% ( 22, 34 ] 166 0.019% 98.547% ( 34, 51 ] 330 0.037% 98.583% ( 51, 76 ] 254 0.028% 98.612% ( 76, 110 ] 142 0.016% 98.628% ( 110, 170 ] 1228 0.137% 98.765% ( 170, 250 ] 2681 0.299% 99.064% ( 250, 380 ] 1620 0.181% 99.244% ( 380, 580 ] 2572 0.287% 99.531% ( 580, 870 ] 2355 0.263% 99.794% ( 870, 1300 ] 1174 0.131% 99.925% ( 1300, 1900 ] 523 0.058% 99.983% ( 1900, 2900 ] 622 0.069% 100.052% ( 2900, 4400 ] 766 0.085% 100.138% ( 4400, 6600 ] 193 0.022% 100.159% ( 6600, 9900 ] 80 0.009% 100.168% ( 9900, 14000 ] 26 0.003% 100.171% ( 14000, 22000 ] 46 0.005% 100.176% ( 22000, 33000 ] 24 0.003% 100.179% ( 33000, 50000 ] 10 0.001% 100.180% ( 50000, 75000 ] 1 0.000% 100.180% ** Level 4 read latency histogram (micros): Count: 1616517 Average: 25.4277 StdDev: 304.12 Min: 1 Median: 2.3976 Max: 53028 Percentiles: P50: 2.40 P75: 3.58 P99: 393.32 P99.9: 1080.03 P99.99: 1292.46 ------------------------------------------------------ [ 0, 1 ] 12858 0.795% 0.795% ( 1, 2 ] 601736 37.224% 38.020% ####### ( 2, 3 ] 487040 30.129% 68.149% ###### ( 3, 4 ] 191800 11.865% 80.014% ## ( 4, 6 ] 208955 12.926% 92.940% ### ( 6, 10 ] 48397 2.994% 95.934% # ( 10, 15 ] 10673 0.660% 96.594% ( 15, 22 ] 1540 0.095% 96.689% ( 22, 34 ] 268 0.017% 96.706% ( 34, 51 ] 582 0.036% 96.742% ( 51, 76 ] 424 0.026% 96.768% ( 76, 110 ] 513 0.032% 96.800% ( 110, 170 ] 9155 0.566% 97.366% ( 170, 250 ] 19141 1.184% 98.550% ( 250, 380 ] 6781 0.419% 98.970% ( 380, 580 ] 7339 0.454% 99.424% ( 580, 870 ] 6260 0.387% 99.811% ( 870, 1300 ] 2945 0.182% 99.993% ( 1300, 1900 ] 1143 0.071% 100.064% ( 1900, 2900 ] 1440 0.089% 100.153% ( 2900, 4400 ] 1648 0.102% 100.255% ( 4400, 6600 ] 389 0.024% 100.279% ( 6600, 9900 ] 153 0.009% 100.288% ( 9900, 14000 ] 45 0.003% 100.291% ( 14000, 22000 ] 81 0.005% 100.296% ( 22000, 33000 ] 38 0.002% 100.299% ( 33000, 50000 ] 17 0.001% 100.300% ( 50000, 75000 ] 2 0.000% 100.300% ** Level 5 read latency histogram (micros): Count: 38185 Average: 537.9525 StdDev: 1353.69 Min: 92 Median: 241.8324 Max: 60980 Percentiles: P50: 241.83 P75: 523.51 P99: 4302.02 P99.9: 14931.43 P99.99: 48655.89 ------------------------------------------------------ ( 76, 110 ] 282 0.739% 0.739% ( 110, 170 ] 6467 16.936% 17.674% ### ( 170, 250 ] 13747 36.001% 53.676% ####### ( 250, 380 ] 4695 12.295% 65.971% ## ( 380, 580 ] 4805 12.583% 78.554% ### ( 580, 870 ] 3997 10.467% 89.022% ## ( 870, 1300 ] 1786 4.677% 93.699% # ( 1300, 1900 ] 599 1.569% 95.268% ( 1900, 2900 ] 626 1.639% 96.907% ( 2900, 4400 ] 855 2.239% 99.146% ( 4400, 6600 ] 224 0.587% 99.733% ( 6600, 9900 ] 54 0.141% 99.874% ( 9900, 14000 ] 9 0.024% 99.898% ( 14000, 22000 ] 7 0.018% 99.916% ( 22000, 33000 ] 7 0.018% 99.935% ( 33000, 50000 ] 23 0.060% 99.995% ( 50000, 75000 ] 1 0.003% 99.997% ** DB Stats ** Uptime(secs): 16.4 total, 3.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 179.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.862 H:M:S, 23.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 268.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.070 H:M:S, 1.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 474.563 micros/op 8406 ops/sec 20.103 seconds 168996 operations; 8.1 MB/s (41999 of 41999 found) Microseconds per read: Count: 168996 Average: 474.5761 StdDev: 1386.14 Min: 2 Median: 244.7268 Max: 92072 Percentiles: P50: 244.73 P75: 433.50 P99: 4129.84 P99.9: 20099.33 P99.99: 49033.47 ------------------------------------------------------ ( 1, 2 ] 2 0.001% 0.001% ( 2, 3 ] 31 0.018% 0.020% ( 3, 4 ] 57 0.034% 0.053% ( 4, 6 ] 153 0.091% 0.144% ( 6, 10 ] 306 0.181% 0.325% ( 10, 15 ] 947 0.560% 0.885% ( 15, 22 ] 2405 1.423% 2.308% ( 22, 34 ] 3104 1.837% 4.145% ( 34, 51 ] 1847 1.093% 5.238% ( 51, 76 ] 246 0.146% 5.384% ( 76, 110 ] 99 0.059% 5.442% ( 110, 170 ] 12566 7.436% 12.878% # ( 170, 250 ] 67162 39.742% 52.620% ######## ( 250, 380 ] 32001 18.936% 71.556% #### ( 380, 580 ] 21762 12.877% 84.433% ### ( 580, 870 ] 13113 7.759% 92.192% ## ( 870, 1300 ] 5946 3.518% 95.711% # ( 1300, 1900 ] 2104 1.245% 96.956% ( 1900, 2900 ] 1648 0.975% 97.931% ( 2900, 4400 ] 2204 1.304% 99.235% ( 4400, 6600 ] 639 0.378% 99.613% ( 6600, 9900 ] 295 0.175% 99.788% ( 9900, 14000 ] 113 0.067% 99.854% ( 14000, 22000 ] 101 0.060% 99.914% ( 22000, 33000 ] 80 0.047% 99.962% ( 33000, 50000 ] 51 0.030% 99.992% ( 50000, 75000 ] 10 0.006% 99.998% ( 75000, 110000 ] 4 0.002% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2672002 rocksdb.bloom.filter.full.positive COUNT : 194223 rocksdb.bloom.filter.full.true.positive COUNT : 168142 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 854 rocksdb.memtable.miss COUNT : 168142 rocksdb.l0.hit COUNT : 17913 rocksdb.l1.hit COUNT : 1943 rocksdb.l2andup.hit COUNT : 148286 rocksdb.compaction.key.drop.new COUNT : 1308637 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3954753 rocksdb.number.keys.read COUNT : 168996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4081305096 rocksdb.bytes.read COUNT : 168996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 559 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 4155346 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16596206609 rocksdb.compact.write.bytes COUNT : 15247262171 rocksdb.flush.write.bytes COUNT : 3956766578 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 25 rocksdb.number.superversion_acquires COUNT : 766 rocksdb.number.superversion_releases COUNT : 748 rocksdb.number.superversion_cleanups COUNT : 189 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 213 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3931509760 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7643136 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 16896636478 rocksdb.non.last.level.read.count COUNT : 4055098 rocksdb.block.checksum.compute.count COUNT : 4217843 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 243.944242 P95 : 1212.693450 P99 : 4129.156080 P100 : 92070.000000 COUNT : 168996 SUM : 80045053 rocksdb.db.write.micros P50 : 1.574682 P95 : 5.033396 P99 : 7.104726 P100 : 704227.000000 COUNT : 3954753 SUM : 15105777 rocksdb.compaction.times.micros P50 : 2020689.655172 P95 : 3810000.000000 P99 : 11438000.000000 P100 : 13798561.000000 COUNT : 61 SUM : 127313266 rocksdb.compaction.times.cpu_micros P50 : 1235000.000000 P95 : 1875500.000000 P99 : 3239044.000000 P100 : 3239044.000000 COUNT : 61 SUM : 73875102 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1120.833333 P95 : 6292.000000 P99 : 9009.000000 P100 : 9102.000000 COUNT : 54 SUM : 101578 rocksdb.compaction.outfile.sync.micros P50 : 2566.666667 P95 : 8360.000000 P99 : 13959.000000 P100 : 38247.000000 COUNT : 204 SUM : 658794 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 230.000000 P95 : 2300.000000 P99 : 4260.000000 P100 : 10318.000000 COUNT : 128 SUM : 68015 rocksdb.table.open.io.micros P50 : 5212.500000 P95 : 17378.947368 P99 : 23503.333333 P100 : 81914.000000 COUNT : 559 SUM : 3474353 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.569853 P95 : 9.720736 P99 : 188.284110 P100 : 62425.000000 COUNT : 4020365 SUM : 67986380 rocksdb.read.block.get.micros P50 : 211.275822 P95 : 1033.369895 P99 : 3733.918080 P100 : 60985.000000 COUNT : 197028 SUM : 72442941 rocksdb.write.raw.block.micros P50 : 0.538610 P95 : 1.455621 P99 : 4.324327 P100 : 97876.000000 COUNT : 4667071 SUM : 18430205 rocksdb.numfiles.in.singlecompaction P50 : 3.161765 P95 : 5.312500 P99 : 7.000000 P100 : 7.000000 COUNT : 75 SUM : 264 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560667 P95 : 1113.482477 P99 : 1293.238551 P100 : 704047.000000 COUNT : 4473 SUM : 4155728 rocksdb.sst.read.micros P50 : 2.206473 P95 : 134.641966 P99 : 590.322410 P100 : 62418.000000 COUNT : 4055304 SUM : 126328026 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 168996 SUM : 168996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3954753 SUM : 4081305096 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 231176.470588 P95 : 894000.000000 P99 : 982721.000000 P100 : 982721.000000 COUNT : 54 SUM : 17542097 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 217 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0