[2024-11-20 08:10:59.627135] Starting SPDK v25.01-pre git sha1 097b7c969 / DPDK 24.03.0 initialization... [2024-11-20 08:10:59.627256] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1277618 ] Set seed to 1732086659624551 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 08:10:59.764900] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 08:10:59.868105] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 08:10:59.868159] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1277618' to capture a snapshot of events at runtime. [2024-11-20 08:10:59.868173] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 08:10:59.868186] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 08:10:59.868195] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1277618 for offline analysis/debug. [2024-11-20 08:10:59.869497] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 08:11:02 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/20-08:11:09 ... thread 0: (1000000,1000000) ops and (151876.7,151876.7) ops/second in (6.584288,6.584288) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.32 GB 75.2 0.2 0.0 0.2 1.1 0.9 0.0 1.3 32.3 145.1 7.79 4.05 12 0.649 255K 1153 0.0 0.0 L2 15/14 1.81 GB 1.3 0.7 0.6 0.1 0.7 0.6 0.0 1.1 123.8 121.8 5.60 3.55 2 2.800 642K 0 0.0 0.0 L3 28/8 1.55 GB 1.1 2.9 1.7 1.3 2.8 1.5 0.1 1.7 137.6 130.6 21.88 14.26 14 1.563 824K 505 0.0 0.0 L4 141/21 10.25 GB 0.9 1.0 0.2 0.8 0.9 0.1 0.7 3.7 129.6 109.5 8.22 5.35 4 2.054 243K 0 0.0 0.0 L5 120/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 317/52 24.16 GB 0.0 4.9 2.5 2.4 5.4 3.1 0.8 6.3 115.5 128.1 43.49 27.21 32 1.359 1966K 1658 0.0 0.0 Int 0/0 0.00 KB 0.0 4.9 2.5 2.4 5.4 3.1 0.8 6.3 115.5 128.1 43.49 27.21 32 1.359 1966K 1658 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.9 2.5 2.4 4.6 2.2 0.0 0.0 134.0 125.2 37.47 24.56 21 1.784 1966K 1658 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 146.2 6.02 2.65 11 0.547 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.7 total, 6.6 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.44 GB write, 836.62 MB/s write, 4.90 GB read, 754.15 MB/s read, 43.5 seconds Interval compaction: 5.44 GB write, 845.83 MB/s write, 4.90 GB read, 762.46 MB/s read, 43.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 18, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 73046 Average: 118.9356 StdDev: 749.93 Min: 1 Median: 2.3222 Max: 51851 Percentiles: P50: 2.32 P75: 3.86 P99: 2436.99 P99.9: 6166.95 P99.99: 24117.81 ------------------------------------------------------ [ 0, 1 ] 1802 2.467% 2.467% ( 1, 2 ] 28941 39.620% 42.087% ######## ( 2, 3 ] 17937 24.556% 66.643% ##### ( 3, 4 ] 7113 9.738% 76.381% ## ( 4, 6 ] 7011 9.598% 85.979% ## ( 6, 10 ] 1795 2.457% 88.436% ( 10, 15 ] 353 0.483% 88.919% ( 15, 22 ] 34 0.047% 88.966% ( 22, 34 ] 7 0.010% 88.975% ( 34, 51 ] 7 0.010% 88.985% ( 51, 76 ] 5 0.007% 88.992% ( 76, 110 ] 1 0.001% 88.993% ( 110, 170 ] 41 0.056% 89.049% ( 170, 250 ] 239 0.327% 89.377% ( 250, 380 ] 1014 1.388% 90.765% ( 380, 580 ] 2311 3.164% 93.928% # ( 580, 870 ] 2330 3.190% 97.118% # ( 870, 1300 ] 947 1.296% 98.415% ( 1300, 1900 ] 260 0.356% 98.771% ( 1900, 2900 ] 312 0.427% 99.198% ( 2900, 4400 ] 423 0.579% 99.777% ( 4400, 6600 ] 112 0.153% 99.930% ( 6600, 9900 ] 14 0.019% 99.949% ( 9900, 14000 ] 11 0.015% 99.964% ( 14000, 22000 ] 16 0.022% 99.986% ( 22000, 33000 ] 14 0.019% 100.005% ( 33000, 50000 ] 5 0.007% 100.012% ( 50000, 75000 ] 1 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 160924 Average: 14.0851 StdDev: 293.58 Min: 1 Median: 2.2837 Max: 38767 Percentiles: P50: 2.28 P75: 3.36 P99: 13.86 P99.9: 2613.57 P99.99: 11092.12 ------------------------------------------------------ [ 0, 1 ] 1706 1.060% 1.060% ( 1, 2 ] 65488 40.695% 41.755% ######## ( 2, 3 ] 46762 29.058% 70.814% ###### ( 3, 4 ] 18747 11.650% 82.463% ## ( 4, 6 ] 20236 12.575% 95.038% ### ( 6, 10 ] 5323 3.308% 98.346% # ( 10, 15 ] 1365 0.848% 99.194% ( 15, 22 ] 193 0.120% 99.314% ( 22, 34 ] 33 0.021% 99.334% ( 34, 51 ] 42 0.026% 99.361% ( 51, 76 ] 34 0.021% 99.382% ( 76, 110 ] 12 0.007% 99.389% ( 110, 170 ] 13 0.008% 99.397% ( 170, 250 ] 46 0.029% 99.426% ( 250, 380 ] 126 0.078% 99.504% ( 380, 580 ] 217 0.135% 99.639% ( 580, 870 ] 171 0.106% 99.745% ( 870, 1300 ] 100 0.062% 99.807% ( 1300, 1900 ] 82 0.051% 99.858% ( 1900, 2900 ] 94 0.058% 99.917% ( 2900, 4400 ] 84 0.052% 99.969% ( 4400, 6600 ] 23 0.014% 99.983% ( 6600, 9900 ] 8 0.005% 99.988% ( 9900, 14000 ] 10 0.006% 99.994% ( 14000, 22000 ] 15 0.009% 100.004% ( 22000, 33000 ] 4 0.002% 100.006% ( 33000, 50000 ] 1 0.001% 100.007% ** Level 2 read latency histogram (micros): Count: 588972 Average: 15.2373 StdDev: 263.95 Min: 0 Median: 2.3242 Max: 44553 Percentiles: P50: 2.32 P75: 3.38 P99: 14.15 P99.9: 1344.77 P99.99: 2506.01 ------------------------------------------------------ [ 0, 1 ] 5229 0.888% 0.888% ( 1, 2 ] 231340 39.279% 40.166% ######## ( 2, 3 ] 178669 30.336% 70.502% ###### ( 3, 4 ] 69436 11.789% 82.292% ## ( 4, 6 ] 75280 12.782% 95.073% ### ( 6, 10 ] 19385 3.291% 98.364% # ( 10, 15 ] 4511 0.766% 99.130% ( 15, 22 ] 575 0.098% 99.228% ( 22, 34 ] 104 0.018% 99.246% ( 34, 51 ] 160 0.027% 99.273% ( 51, 76 ] 111 0.019% 99.292% ( 76, 110 ] 34 0.006% 99.297% ( 110, 170 ] 45 0.008% 99.305% ( 170, 250 ] 189 0.032% 99.337% ( 250, 380 ] 617 0.105% 99.442% ( 380, 580 ] 1133 0.192% 99.634% ( 580, 870 ] 1022 0.174% 99.808% ( 870, 1300 ] 519 0.088% 99.896% ( 1300, 1900 ] 322 0.055% 99.951% ( 1900, 2900 ] 383 0.065% 100.016% ( 2900, 4400 ] 441 0.075% 100.090% ( 4400, 6600 ] 117 0.020% 100.110% ( 6600, 9900 ] 33 0.006% 100.116% ( 9900, 14000 ] 16 0.003% 100.119% ( 14000, 22000 ] 30 0.005% 100.124% ( 22000, 33000 ] 11 0.002% 100.126% ( 33000, 50000 ] 5 0.001% 100.126% ** Level 3 read latency histogram (micros): Count: 391805 Average: 15.6563 StdDev: 245.21 Min: 1 Median: 2.2965 Max: 38958 Percentiles: P50: 2.30 P75: 3.34 P99: 36.47 P99.9: 1343.98 P99.99: 2625.86 ------------------------------------------------------ [ 0, 1 ] 4303 1.098% 1.098% ( 1, 2 ] 156904 40.046% 41.145% ######## ( 2, 3 ] 117004 29.863% 71.008% ###### ( 3, 4 ] 45790 11.687% 82.694% ## ( 4, 6 ] 48505 12.380% 95.074% ## ( 6, 10 ] 12588 3.213% 98.287% # ( 10, 15 ] 2444 0.624% 98.911% ( 15, 22 ] 267 0.068% 98.979% ( 22, 34 ] 63 0.016% 98.995% ( 34, 51 ] 137 0.035% 99.030% ( 51, 76 ] 84 0.021% 99.052% ( 76, 110 ] 23 0.006% 99.057% ( 110, 170 ] 41 0.010% 99.068% ( 170, 250 ] 198 0.051% 99.118% ( 250, 380 ] 577 0.147% 99.266% ( 380, 580 ] 1028 0.262% 99.528% ( 580, 870 ] 954 0.243% 99.772% ( 870, 1300 ] 491 0.125% 99.897% ( 1300, 1900 ] 180 0.046% 99.943% ( 1900, 2900 ] 256 0.065% 100.008% ( 2900, 4400 ] 268 0.068% 100.077% ( 4400, 6600 ] 66 0.017% 100.093% ( 6600, 9900 ] 22 0.006% 100.099% ( 9900, 14000 ] 12 0.003% 100.102% ( 14000, 22000 ] 13 0.003% 100.105% ( 22000, 33000 ] 8 0.002% 100.107% ( 33000, 50000 ] 2 0.001% 100.108% ** Level 4 read latency histogram (micros): Count: 449378 Average: 32.9943 StdDev: 419.21 Min: 1 Median: 2.3905 Max: 50668 Percentiles: P50: 2.39 P75: 3.55 P99: 639.42 P99.9: 2281.45 P99.99: 2988.13 ------------------------------------------------------ [ 0, 1 ] 3865 0.860% 0.860% ( 1, 2 ] 168606 37.520% 38.380% ######## ( 2, 3 ] 133731 29.759% 68.139% ###### ( 3, 4 ] 55740 12.404% 80.543% ## ( 4, 6 ] 58866 13.099% 93.642% ### ( 6, 10 ] 15172 3.376% 97.019% # ( 10, 15 ] 3289 0.732% 97.750% ( 15, 22 ] 340 0.076% 97.826% ( 22, 34 ] 73 0.016% 97.842% ( 34, 51 ] 123 0.027% 97.870% ( 51, 76 ] 129 0.029% 97.898% ( 76, 110 ] 31 0.007% 97.905% ( 110, 170 ] 78 0.017% 97.923% ( 170, 250 ] 363 0.081% 98.003% ( 250, 380 ] 1213 0.270% 98.273% ( 380, 580 ] 2721 0.606% 98.879% ( 580, 870 ] 2656 0.591% 99.470% ( 870, 1300 ] 1243 0.277% 99.747% ( 1300, 1900 ] 468 0.104% 99.851% ( 1900, 2900 ] 581 0.129% 99.980% ( 2900, 4400 ] 767 0.171% 100.151% ( 4400, 6600 ] 201 0.045% 100.195% ( 6600, 9900 ] 47 0.010% 100.206% ( 9900, 14000 ] 27 0.006% 100.212% ( 14000, 22000 ] 51 0.011% 100.223% ( 22000, 33000 ] 20 0.004% 100.228% ( 33000, 50000 ] 12 0.003% 100.230% ( 50000, 75000 ] 1 0.000% 100.231% ** Level 5 read latency histogram (micros): Count: 7802 Average: 1126.8602 StdDev: 2132.09 Min: 103 Median: 651.7310 Max: 52984 Percentiles: P50: 651.73 P75: 1051.06 P99: 6232.97 P99.9: 32481.06 P99.99: 52984.00 ------------------------------------------------------ ( 76, 110 ] 1 0.013% 0.013% ( 110, 170 ] 49 0.628% 0.641% ( 170, 250 ] 257 3.294% 3.935% # ( 250, 380 ] 963 12.343% 16.278% ## ( 380, 580 ] 2118 27.147% 43.425% ##### ( 580, 870 ] 2074 26.583% 70.008% ##### ( 870, 1300 ] 925 11.856% 81.864% ## ( 1300, 1900 ] 387 4.960% 86.824% # ( 1900, 2900 ] 355 4.550% 91.374% # ( 2900, 4400 ] 495 6.345% 97.719% # ( 4400, 6600 ] 120 1.538% 99.257% ( 6600, 9900 ] 16 0.205% 99.462% ( 9900, 14000 ] 8 0.103% 99.564% ( 14000, 22000 ] 10 0.128% 99.692% ( 22000, 33000 ] 17 0.218% 99.910% ( 33000, 50000 ] 6 0.077% 99.987% ( 50000, 75000 ] 1 0.013% 100.000% ** DB Stats ** Uptime(secs): 6.7 total, 6.6 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 147.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.934 H:M:S, 29.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 149.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.934 H:M:S, 29.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/20-08:11:16 ... thread 0: (1000000,2000000) ops and (143080.6,147347.5) ops/second in (6.989069,13.573357) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 2.29 GB 175.2 1.2 0.0 1.2 3.0 1.8 0.0 1.6 47.9 123.2 24.95 11.69 28 0.891 1213K 6702 0.0 0.0 L2 0/0 0.00 KB 0.0 0.7 0.6 0.1 0.7 0.6 0.0 1.1 123.8 121.8 5.60 3.55 2 2.800 642K 0 0.0 0.0 L3 26/9 1.86 GB 1.0 4.9 3.5 1.4 4.7 3.3 0.1 1.4 135.6 130.7 37.16 24.68 17 2.186 2348K 505 0.0 0.0 L4 149/3 9.75 GB 1.0 6.4 1.6 4.8 5.4 0.6 0.8 3.4 145.1 123.2 45.26 30.54 20 2.263 1653K 0 0.0 0.0 L5 136/0 10.40 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 328/21 24.30 GB 0.0 13.2 5.7 7.5 13.9 6.4 2.1 7.5 119.4 125.6 112.98 70.47 67 1.686 5858K 7207 0.0 0.0 Int 0/0 0.00 KB 0.0 13.2 5.7 7.5 13.9 6.4 2.1 7.5 119.4 125.6 112.98 70.47 67 1.686 5858K 7207 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.2 5.7 7.5 12.0 4.5 0.0 0.0 133.4 121.6 101.16 64.79 43 2.352 5858K 7207 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 159.6 11.82 5.68 24 0.492 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.6 total, 13.6 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.86 GB write, 1039.82 MB/s write, 13.18 GB read, 988.70 MB/s read, 113.0 seconds Interval compaction: 13.86 GB write, 1045.37 MB/s write, 13.18 GB read, 993.98 MB/s read, 113.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 27, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 348055 Average: 81.9589 StdDev: 619.33 Min: 1 Median: 2.1463 Max: 61980 Percentiles: P50: 2.15 P75: 3.52 P99: 1244.83 P99.9: 4206.63 P99.99: 5865.42 ------------------------------------------------------ [ 0, 1 ] 9621 2.764% 2.764% # ( 1, 2 ] 152231 43.738% 46.502% ######### ( 2, 3 ] 83230 23.913% 70.415% ##### ( 3, 4 ] 30896 8.877% 79.291% ## ( 4, 6 ] 29515 8.480% 87.771% ## ( 6, 10 ] 8380 2.408% 90.179% ( 10, 15 ] 1433 0.412% 90.591% ( 15, 22 ] 152 0.044% 90.635% ( 22, 34 ] 27 0.008% 90.642% ( 34, 51 ] 30 0.009% 90.651% ( 51, 76 ] 19 0.005% 90.656% ( 76, 110 ] 9 0.003% 90.659% ( 110, 170 ] 535 0.154% 90.813% ( 170, 250 ] 3700 1.063% 91.876% ( 250, 380 ] 6866 1.973% 93.848% ( 380, 580 ] 8548 2.456% 96.304% ( 580, 870 ] 6968 2.002% 98.306% ( 870, 1300 ] 2771 0.796% 99.102% ( 1300, 1900 ] 806 0.232% 99.334% ( 1900, 2900 ] 957 0.275% 99.609% ( 2900, 4400 ] 1164 0.334% 99.943% ( 4400, 6600 ] 245 0.070% 100.014% ( 6600, 9900 ] 40 0.011% 100.025% ( 9900, 14000 ] 26 0.007% 100.033% ( 14000, 22000 ] 66 0.019% 100.052% ( 22000, 33000 ] 43 0.012% 100.064% ( 33000, 50000 ] 18 0.005% 100.069% ( 50000, 75000 ] 4 0.001% 100.070% ** Level 1 read latency histogram (micros): Count: 160924 Average: 14.0851 StdDev: 293.58 Min: 1 Median: 2.2837 Max: 38767 Percentiles: P50: 2.28 P75: 3.36 P99: 13.86 P99.9: 2613.57 P99.99: 11092.12 ------------------------------------------------------ [ 0, 1 ] 1706 1.060% 1.060% ( 1, 2 ] 65488 40.695% 41.755% ######## ( 2, 3 ] 46762 29.058% 70.814% ###### ( 3, 4 ] 18747 11.650% 82.463% ## ( 4, 6 ] 20236 12.575% 95.038% ### ( 6, 10 ] 5323 3.308% 98.346% # ( 10, 15 ] 1365 0.848% 99.194% ( 15, 22 ] 193 0.120% 99.314% ( 22, 34 ] 33 0.021% 99.334% ( 34, 51 ] 42 0.026% 99.361% ( 51, 76 ] 34 0.021% 99.382% ( 76, 110 ] 12 0.007% 99.389% ( 110, 170 ] 13 0.008% 99.397% ( 170, 250 ] 46 0.029% 99.426% ( 250, 380 ] 126 0.078% 99.504% ( 380, 580 ] 217 0.135% 99.639% ( 580, 870 ] 171 0.106% 99.745% ( 870, 1300 ] 100 0.062% 99.807% ( 1300, 1900 ] 82 0.051% 99.858% ( 1900, 2900 ] 94 0.058% 99.917% ( 2900, 4400 ] 84 0.052% 99.969% ( 4400, 6600 ] 23 0.014% 99.983% ( 6600, 9900 ] 8 0.005% 99.988% ( 9900, 14000 ] 10 0.006% 99.994% ( 14000, 22000 ] 15 0.009% 100.004% ( 22000, 33000 ] 4 0.002% 100.006% ( 33000, 50000 ] 1 0.001% 100.007% ** Level 2 read latency histogram (micros): Count: 823780 Average: 15.1370 StdDev: 271.70 Min: 0 Median: 2.3375 Max: 63961 Percentiles: P50: 2.34 P75: 3.38 P99: 14.65 P99.9: 1534.35 P99.99: 2878.99 ------------------------------------------------------ [ 0, 1 ] 6355 0.771% 0.771% ( 1, 2 ] 319560 38.792% 39.563% ######## ( 2, 3 ] 254755 30.925% 70.488% ###### ( 3, 4 ] 96533 11.718% 82.207% ## ( 4, 6 ] 105121 12.761% 94.968% ### ( 6, 10 ] 27488 3.337% 98.304% # ( 10, 15 ] 6168 0.749% 99.053% ( 15, 22 ] 742 0.090% 99.143% ( 22, 34 ] 136 0.017% 99.160% ( 34, 51 ] 205 0.025% 99.185% ( 51, 76 ] 166 0.020% 99.205% ( 76, 110 ] 43 0.005% 99.210% ( 110, 170 ] 84 0.010% 99.220% ( 170, 250 ] 443 0.054% 99.274% ( 250, 380 ] 1066 0.129% 99.403% ( 380, 580 ] 1682 0.204% 99.608% ( 580, 870 ] 1516 0.184% 99.792% ( 870, 1300 ] 728 0.088% 99.880% ( 1300, 1900 ] 423 0.051% 99.931% ( 1900, 2900 ] 494 0.060% 99.991% ( 2900, 4400 ] 548 0.067% 100.058% ( 4400, 6600 ] 152 0.018% 100.076% ( 6600, 9900 ] 45 0.005% 100.082% ( 9900, 14000 ] 21 0.003% 100.084% ( 14000, 22000 ] 49 0.006% 100.090% ( 22000, 33000 ] 18 0.002% 100.092% ( 33000, 50000 ] 5 0.001% 100.093% ( 50000, 75000 ] 1 0.000% 100.093% ** Level 3 read latency histogram (micros): Count: 950341 Average: 14.2221 StdDev: 232.07 Min: 1 Median: 2.2855 Max: 42020 Percentiles: P50: 2.29 P75: 3.25 P99: 21.76 P99.9: 948.40 P99.99: 1426.51 ------------------------------------------------------ [ 0, 1 ] 8080 0.850% 0.850% ( 1, 2 ] 382854 40.286% 41.136% ######## ( 2, 3 ] 295089 31.051% 72.187% ###### ( 3, 4 ] 108412 11.408% 83.595% ## ( 4, 6 ] 110059 11.581% 95.176% ## ( 6, 10 ] 29953 3.152% 98.328% # ( 10, 15 ] 5791 0.609% 98.937% ( 15, 22 ] 621 0.065% 99.002% ( 22, 34 ] 130 0.014% 99.016% ( 34, 51 ] 260 0.027% 99.043% ( 51, 76 ] 191 0.020% 99.063% ( 76, 110 ] 48 0.005% 99.068% ( 110, 170 ] 172 0.018% 99.087% ( 170, 250 ] 959 0.101% 99.187% ( 250, 380 ] 1971 0.207% 99.395% ( 380, 580 ] 2542 0.267% 99.662% ( 580, 870 ] 2086 0.220% 99.882% ( 870, 1300 ] 947 0.100% 99.981% ( 1300, 1900 ] 384 0.040% 100.022% ( 1900, 2900 ] 517 0.054% 100.076% ( 2900, 4400 ] 520 0.055% 100.131% ( 4400, 6600 ] 128 0.013% 100.144% ( 6600, 9900 ] 38 0.004% 100.148% ( 9900, 14000 ] 19 0.002% 100.150% ( 14000, 22000 ] 27 0.003% 100.153% ( 22000, 33000 ] 17 0.002% 100.155% ( 33000, 50000 ] 6 0.001% 100.156% ** Level 4 read latency histogram (micros): Count: 1275203 Average: 25.8889 StdDev: 374.70 Min: 1 Median: 2.3526 Max: 70097 Percentiles: P50: 2.35 P75: 3.47 P99: 468.99 P99.9: 1234.14 P99.99: 1780.05 ------------------------------------------------------ [ 0, 1 ] 12527 0.982% 0.982% ( 1, 2 ] 491311 38.528% 39.510% ######## ( 2, 3 ] 379347 29.748% 69.258% ###### ( 3, 4 ] 155869 12.223% 81.481% ## ( 4, 6 ] 159803 12.532% 94.013% ### ( 6, 10 ] 42098 3.301% 97.314% # ( 10, 15 ] 9218 0.723% 98.037% ( 15, 22 ] 983 0.077% 98.114% ( 22, 34 ] 201 0.016% 98.130% ( 34, 51 ] 310 0.024% 98.154% ( 51, 76 ] 312 0.024% 98.179% ( 76, 110 ] 91 0.007% 98.186% ( 110, 170 ] 428 0.034% 98.219% ( 170, 250 ] 2401 0.188% 98.408% ( 250, 380 ] 4613 0.362% 98.770% ( 380, 580 ] 6605 0.518% 99.287% ( 580, 870 ] 5703 0.447% 99.735% ( 870, 1300 ] 2489 0.195% 99.930% ( 1300, 1900 ] 958 0.075% 100.005% ( 1900, 2900 ] 1205 0.094% 100.100% ( 2900, 4400 ] 1390 0.109% 100.209% ( 4400, 6600 ] 337 0.026% 100.235% ( 6600, 9900 ] 117 0.009% 100.244% ( 9900, 14000 ] 60 0.005% 100.249% ( 14000, 22000 ] 128 0.010% 100.259% ( 22000, 33000 ] 54 0.004% 100.263% ( 33000, 50000 ] 22 0.002% 100.265% ( 50000, 75000 ] 4 0.000% 100.265% ** Level 5 read latency histogram (micros): Count: 18476 Average: 911.4866 StdDev: 1973.70 Min: 103 Median: 532.0034 Max: 64154 Percentiles: P50: 532.00 P75: 829.68 P99: 5715.62 P99.9: 31529.38 P99.99: 63452.50 ------------------------------------------------------ ( 76, 110 ] 10 0.054% 0.054% ( 110, 170 ] 335 1.813% 1.867% ( 170, 250 ] 1862 10.078% 11.945% ## ( 250, 380 ] 3484 18.857% 30.802% #### ( 380, 580 ] 4667 25.260% 56.062% ##### ( 580, 870 ] 4064 21.996% 78.058% #### ( 870, 1300 ] 1718 9.299% 87.357% ## ( 1300, 1900 ] 615 3.329% 90.685% # ( 1900, 2900 ] 622 3.367% 94.052% # ( 2900, 4400 ] 806 4.362% 98.414% # ( 4400, 6600 ] 181 0.980% 99.394% ( 6600, 9900 ] 33 0.179% 99.572% ( 9900, 14000 ] 17 0.092% 99.664% ( 14000, 22000 ] 21 0.114% 99.778% ( 22000, 33000 ] 26 0.141% 99.919% ( 33000, 50000 ] 11 0.060% 99.978% ( 50000, 75000 ] 4 0.022% 100.000% ** DB Stats ** Uptime(secs): 13.6 total, 7.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 144.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.598 H:M:S, 33.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 140.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.664 H:M:S, 38.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/20-08:11:22 ... thread 0: (1000000,3000000) ops and (160825.4,151581.9) ops/second in (6.217925,19.791282) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.27 GB 175.2 2.5 0.0 2.5 5.3 2.8 0.0 1.9 75.8 162.5 33.20 19.43 49 0.678 2554K 13K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.7 0.6 0.1 0.7 0.6 0.0 1.1 123.8 121.8 5.60 3.55 2 2.800 642K 0 0.0 0.0 L3 17/0 980.84 MB 1.0 4.9 3.5 1.4 4.7 3.3 0.1 1.4 135.6 130.7 37.16 24.68 17 2.186 2348K 505 0.0 0.0 L4 145/0 9.54 GB 1.0 7.3 2.5 4.9 6.4 1.5 0.8 2.6 145.3 126.1 51.75 35.24 23 2.250 2592K 0 0.0 0.0 L5 152/0 11.50 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 332/10 25.27 GB 0.0 15.4 6.6 8.8 17.1 8.3 3.2 6.0 123.5 136.7 127.72 82.90 91 1.403 8138K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.4 6.6 8.8 17.1 8.3 3.2 6.0 123.5 136.7 127.72 82.90 91 1.403 8138K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.4 6.6 8.8 14.2 5.4 0.0 0.0 139.8 129.2 112.76 74.49 51 2.211 8138K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 193.4 14.96 8.41 40 0.374 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.9 total, 19.8 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.05 GB write, 878.90 MB/s write, 15.40 GB read, 793.76 MB/s read, 127.7 seconds Interval compaction: 17.05 GB write, 882.12 MB/s write, 15.40 GB read, 796.66 MB/s read, 127.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 27, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 762426 Average: 50.8268 StdDev: 422.22 Min: 0 Median: 1.7552 Max: 61980 Percentiles: P50: 1.76 P75: 2.83 P99: 786.44 P99.9: 3253.83 P99.99: 4138.09 ------------------------------------------------------ [ 0, 1 ] 93661 12.285% 12.285% ## ( 1, 2 ] 380748 49.939% 62.224% ########## ( 2, 3 ] 117959 15.472% 77.695% ### ( 3, 4 ] 40610 5.326% 83.022% # ( 4, 6 ] 35887 4.707% 87.729% # ( 6, 10 ] 10415 1.366% 89.095% ( 10, 15 ] 1772 0.232% 89.327% ( 15, 22 ] 219 0.029% 89.356% ( 22, 34 ] 54 0.007% 89.363% ( 34, 51 ] 32 0.004% 89.367% ( 51, 76 ] 21 0.003% 89.370% ( 76, 110 ] 776 0.102% 89.472% ( 110, 170 ] 16646 2.183% 91.655% ( 170, 250 ] 30889 4.051% 95.706% # ( 250, 380 ] 10507 1.378% 97.084% ( 380, 580 ] 9565 1.255% 98.339% ( 580, 870 ] 7084 0.929% 99.268% ( 870, 1300 ] 2779 0.364% 99.632% ( 1300, 1900 ] 810 0.106% 99.739% ( 1900, 2900 ] 957 0.126% 99.864% ( 2900, 4400 ] 1164 0.153% 100.017% ( 4400, 6600 ] 245 0.032% 100.049% ( 6600, 9900 ] 40 0.005% 100.054% ( 9900, 14000 ] 26 0.003% 100.058% ( 14000, 22000 ] 66 0.009% 100.066% ( 22000, 33000 ] 43 0.006% 100.072% ( 33000, 50000 ] 18 0.002% 100.074% ( 50000, 75000 ] 4 0.001% 100.075% ** Level 1 read latency histogram (micros): Count: 160924 Average: 14.0851 StdDev: 293.58 Min: 1 Median: 2.2837 Max: 38767 Percentiles: P50: 2.28 P75: 3.36 P99: 13.86 P99.9: 2613.57 P99.99: 11092.12 ------------------------------------------------------ [ 0, 1 ] 1706 1.060% 1.060% ( 1, 2 ] 65488 40.695% 41.755% ######## ( 2, 3 ] 46762 29.058% 70.814% ###### ( 3, 4 ] 18747 11.650% 82.463% ## ( 4, 6 ] 20236 12.575% 95.038% ### ( 6, 10 ] 5323 3.308% 98.346% # ( 10, 15 ] 1365 0.848% 99.194% ( 15, 22 ] 193 0.120% 99.314% ( 22, 34 ] 33 0.021% 99.334% ( 34, 51 ] 42 0.026% 99.361% ( 51, 76 ] 34 0.021% 99.382% ( 76, 110 ] 12 0.007% 99.389% ( 110, 170 ] 13 0.008% 99.397% ( 170, 250 ] 46 0.029% 99.426% ( 250, 380 ] 126 0.078% 99.504% ( 380, 580 ] 217 0.135% 99.639% ( 580, 870 ] 171 0.106% 99.745% ( 870, 1300 ] 100 0.062% 99.807% ( 1300, 1900 ] 82 0.051% 99.858% ( 1900, 2900 ] 94 0.058% 99.917% ( 2900, 4400 ] 84 0.052% 99.969% ( 4400, 6600 ] 23 0.014% 99.983% ( 6600, 9900 ] 8 0.005% 99.988% ( 9900, 14000 ] 10 0.006% 99.994% ( 14000, 22000 ] 15 0.009% 100.004% ( 22000, 33000 ] 4 0.002% 100.006% ( 33000, 50000 ] 1 0.001% 100.007% ** Level 2 read latency histogram (micros): Count: 824088 Average: 15.2031 StdDev: 271.67 Min: 0 Median: 2.3381 Max: 63961 Percentiles: P50: 2.34 P75: 3.39 P99: 14.89 P99.9: 1533.92 P99.99: 2878.93 ------------------------------------------------------ [ 0, 1 ] 6355 0.771% 0.771% ( 1, 2 ] 319560 38.777% 39.549% ######## ( 2, 3 ] 254755 30.914% 70.462% ###### ( 3, 4 ] 96533 11.714% 82.176% ## ( 4, 6 ] 105121 12.756% 94.932% ### ( 6, 10 ] 27488 3.336% 98.268% # ( 10, 15 ] 6168 0.748% 99.016% ( 15, 22 ] 742 0.090% 99.106% ( 22, 34 ] 136 0.017% 99.123% ( 34, 51 ] 205 0.025% 99.148% ( 51, 76 ] 166 0.020% 99.168% ( 76, 110 ] 46 0.006% 99.173% ( 110, 170 ] 191 0.023% 99.196% ( 170, 250 ] 614 0.075% 99.271% ( 250, 380 ] 1090 0.132% 99.403% ( 380, 580 ] 1685 0.204% 99.608% ( 580, 870 ] 1516 0.184% 99.792% ( 870, 1300 ] 728 0.088% 99.880% ( 1300, 1900 ] 423 0.051% 99.931% ( 1900, 2900 ] 494 0.060% 99.991% ( 2900, 4400 ] 548 0.066% 100.058% ( 4400, 6600 ] 152 0.018% 100.076% ( 6600, 9900 ] 45 0.005% 100.082% ( 9900, 14000 ] 21 0.003% 100.084% ( 14000, 22000 ] 49 0.006% 100.090% ( 22000, 33000 ] 18 0.002% 100.092% ( 33000, 50000 ] 5 0.001% 100.093% ( 50000, 75000 ] 1 0.000% 100.093% ** Level 3 read latency histogram (micros): Count: 966290 Average: 15.5766 StdDev: 230.78 Min: 1 Median: 2.2945 Max: 42020 Percentiles: P50: 2.29 P75: 3.29 P99: 231.74 P99.9: 934.35 P99.99: 1400.58 ------------------------------------------------------ [ 0, 1 ] 8247 0.853% 0.853% ( 1, 2 ] 387334 40.085% 40.938% ######## ( 2, 3 ] 297329 30.770% 71.708% ###### ( 3, 4 ] 108983 11.278% 82.987% ## ( 4, 6 ] 110542 11.440% 94.427% ## ( 6, 10 ] 30146 3.120% 97.546% # ( 10, 15 ] 5812 0.601% 98.148% ( 15, 22 ] 624 0.065% 98.212% ( 22, 34 ] 130 0.013% 98.226% ( 34, 51 ] 260 0.027% 98.253% ( 51, 76 ] 191 0.020% 98.273% ( 76, 110 ] 158 0.016% 98.289% ( 110, 170 ] 2779 0.288% 98.577% ( 170, 250 ] 5302 0.549% 99.125% ( 250, 380 ] 2533 0.262% 99.387% ( 380, 580 ] 2708 0.280% 99.668% ( 580, 870 ] 2104 0.218% 99.885% ( 870, 1300 ] 947 0.098% 99.983% ( 1300, 1900 ] 384 0.040% 100.023% ( 1900, 2900 ] 517 0.054% 100.077% ( 2900, 4400 ] 520 0.054% 100.130% ( 4400, 6600 ] 128 0.013% 100.144% ( 6600, 9900 ] 38 0.004% 100.148% ( 9900, 14000 ] 19 0.002% 100.150% ( 14000, 22000 ] 27 0.003% 100.152% ( 22000, 33000 ] 17 0.002% 100.154% ( 33000, 50000 ] 6 0.001% 100.155% ** Level 4 read latency histogram (micros): Count: 1320929 Average: 31.2639 StdDev: 369.51 Min: 1 Median: 2.4108 Max: 70097 Percentiles: P50: 2.41 P75: 3.68 P99: 472.48 P99.9: 1226.51 P99.99: 1777.81 ------------------------------------------------------ [ 0, 1 ] 12566 0.951% 0.951% ( 1, 2 ] 491718 37.225% 38.176% ####### ( 2, 3 ] 380174 28.781% 66.957% ###### ( 3, 4 ] 156486 11.847% 78.804% ## ( 4, 6 ] 160703 12.166% 90.970% ## ( 6, 10 ] 42189 3.194% 94.164% # ( 10, 15 ] 9260 0.701% 94.865% ( 15, 22 ] 990 0.075% 94.940% ( 22, 34 ] 205 0.016% 94.955% ( 34, 51 ] 310 0.023% 94.979% ( 51, 76 ] 312 0.024% 95.002% ( 76, 110 ] 861 0.065% 95.067% ( 110, 170 ] 14597 1.105% 96.173% ( 170, 250 ] 26286 1.990% 98.163% ( 250, 380 ] 7610 0.576% 98.739% ( 380, 580 ] 7467 0.565% 99.304% ( 580, 870 ] 5808 0.440% 99.744% ( 870, 1300 ] 2492 0.189% 99.932% ( 1300, 1900 ] 958 0.073% 100.005% ( 1900, 2900 ] 1205 0.091% 100.096% ( 2900, 4400 ] 1390 0.105% 100.201% ( 4400, 6600 ] 337 0.026% 100.227% ( 6600, 9900 ] 117 0.009% 100.236% ( 9900, 14000 ] 60 0.005% 100.240% ( 14000, 22000 ] 128 0.010% 100.250% ( 22000, 33000 ] 54 0.004% 100.254% ( 33000, 50000 ] 22 0.002% 100.256% ( 50000, 75000 ] 4 0.000% 100.256% ** Level 5 read latency histogram (micros): Count: 51781 Average: 449.8765 StdDev: 1229.10 Min: 90 Median: 224.6172 Max: 64154 Percentiles: P50: 224.62 P75: 404.56 P99: 3979.76 P99.9: 17512.00 P99.99: 46633.85 ------------------------------------------------------ ( 76, 110 ] 541 1.045% 1.045% ( 110, 170 ] 11432 22.078% 23.122% #### ( 170, 250 ] 20387 39.372% 62.494% ######## ( 250, 380 ] 5813 11.226% 73.720% ## ( 380, 580 ] 5405 10.438% 84.158% ## ( 580, 870 ] 4148 8.011% 92.169% ## ( 870, 1300 ] 1721 3.324% 95.493% # ( 1300, 1900 ] 615 1.188% 96.680% ( 1900, 2900 ] 622 1.201% 97.881% ( 2900, 4400 ] 806 1.557% 99.438% ( 4400, 6600 ] 181 0.350% 99.788% ( 6600, 9900 ] 33 0.064% 99.851% ( 9900, 14000 ] 17 0.033% 99.884% ( 14000, 22000 ] 21 0.041% 99.925% ( 22000, 33000 ] 26 0.050% 99.975% ( 33000, 50000 ] 11 0.021% 99.996% ( 50000, 75000 ] 4 0.008% 100.004% ** DB Stats ** Uptime(secs): 19.9 total, 6.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 148.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.021 H:M:S, 35.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 158.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.423 H:M:S, 39.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 514.745 micros/op 7738 ops/sec 20.288 seconds 156996 operations; 7.5 MB/s (39999 of 39999 found) Microseconds per read: Count: 156996 Average: 514.7599 StdDev: 1508.03 Min: 2 Median: 257.8041 Max: 82514 Percentiles: P50: 257.80 P75: 481.57 P99: 4215.61 P99.9: 23645.27 P99.99: 59022.17 ------------------------------------------------------ ( 1, 2 ] 6 0.004% 0.004% ( 2, 3 ] 34 0.022% 0.025% ( 3, 4 ] 59 0.038% 0.063% ( 4, 6 ] 103 0.066% 0.129% ( 6, 10 ] 231 0.147% 0.276% ( 10, 15 ] 1101 0.701% 0.977% ( 15, 22 ] 1682 1.071% 2.048% ( 22, 34 ] 2932 1.868% 3.916% ( 34, 51 ] 1829 1.165% 5.081% ( 51, 76 ] 331 0.211% 5.292% ( 76, 110 ] 107 0.068% 5.360% ( 110, 170 ] 10506 6.692% 12.052% # ( 170, 250 ] 57788 36.809% 48.860% ####### ( 250, 380 ] 29801 18.982% 67.842% #### ( 380, 580 ] 22126 14.093% 81.936% ### ( 580, 870 ] 14018 8.929% 90.865% ## ( 870, 1300 ] 6524 4.156% 95.020% # ( 1300, 1900 ] 2557 1.629% 96.649% ( 1900, 2900 ] 1772 1.129% 97.778% ( 2900, 4400 ] 2188 1.394% 99.171% ( 4400, 6600 ] 616 0.392% 99.564% ( 6600, 9900 ] 281 0.179% 99.743% ( 9900, 14000 ] 101 0.064% 99.807% ( 14000, 22000 ] 130 0.083% 99.890% ( 22000, 33000 ] 107 0.068% 99.958% ( 33000, 50000 ] 42 0.027% 99.985% ( 50000, 75000 ] 23 0.015% 99.999% ( 75000, 110000 ] 1 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2628778 rocksdb.bloom.filter.full.positive COUNT : 182308 rocksdb.bloom.filter.full.true.positive COUNT : 156335 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 661 rocksdb.memtable.miss COUNT : 156335 rocksdb.l0.hit COUNT : 18620 rocksdb.l1.hit COUNT : 287 rocksdb.l2andup.hit COUNT : 137428 rocksdb.compaction.key.drop.new COUNT : 1224605 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3140141 rocksdb.number.keys.read COUNT : 156996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3240625512 rocksdb.bytes.read COUNT : 156996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 536 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 7021070 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16953707443 rocksdb.compact.write.bytes COUNT : 15691751318 rocksdb.flush.write.bytes COUNT : 3165170445 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 33 rocksdb.number.superversion_acquires COUNT : 642 rocksdb.number.superversion_releases COUNT : 625 rocksdb.number.superversion_cleanups COUNT : 159 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 201 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3145217024 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6347776 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 17195823160 rocksdb.non.last.level.read.count COUNT : 4128382 rocksdb.block.checksum.compute.count COUNT : 4292317 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 255.096387 P95 : 1297.237319 P99 : 4213.726027 P100 : 82513.000000 COUNT : 156996 SUM : 80654252 rocksdb.db.write.micros P50 : 1.604131 P95 : 5.179833 P99 : 8.049555 P100 : 830378.000000 COUNT : 3140141 SUM : 15946228 rocksdb.compaction.times.micros P50 : 1950000.000000 P95 : 5840000.000000 P99 : 17840000.000000 P100 : 19005642.000000 COUNT : 52 SUM : 131762815 rocksdb.compaction.times.cpu_micros P50 : 1355555.555556 P95 : 2500000.000000 P99 : 8010303.000000 P100 : 8010303.000000 COUNT : 52 SUM : 76971009 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1480.000000 P95 : 6116.000000 P99 : 7572.000000 P100 : 7572.000000 COUNT : 42 SUM : 92002 rocksdb.compaction.outfile.sync.micros P50 : 1655.555556 P95 : 7755.000000 P99 : 10064.000000 P100 : 44943.000000 COUNT : 196 SUM : 520391 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 288.235294 P95 : 3000.000000 P99 : 4112.000000 P100 : 4112.000000 COUNT : 112 SUM : 69560 rocksdb.table.open.io.micros P50 : 5067.857143 P95 : 19694.117647 P99 : 31145.714286 P100 : 57417.000000 COUNT : 536 SUM : 3455865 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.605711 P95 : 9.858840 P99 : 243.316551 P100 : 61988.000000 COUNT : 4106900 SUM : 74668919 rocksdb.read.block.get.micros P50 : 218.683157 P95 : 1102.858544 P99 : 3786.959768 P100 : 70102.000000 COUNT : 184936 SUM : 73796636 rocksdb.write.raw.block.micros P50 : 0.535330 P95 : 1.371909 P99 : 3.815779 P100 : 75344.000000 COUNT : 4569154 SUM : 18085965 rocksdb.numfiles.in.singlecompaction P50 : 3.384615 P95 : 5.722222 P99 : 11.500000 P100 : 12.000000 COUNT : 70 SUM : 258 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.557760 P95 : 1111.667835 P99 : 1296.323756 P100 : 830187.000000 COUNT : 30640 SUM : 7023634 rocksdb.sst.read.micros P50 : 2.254725 P95 : 145.121595 P99 : 608.905376 P100 : 70097.000000 COUNT : 4128471 SUM : 135215799 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 156996 SUM : 156996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3140141 SUM : 3240625512 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 305714.285714 P95 : 850333.333333 P99 : 1126103.000000 P100 : 1126103.000000 COUNT : 42 SUM : 15347237 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 206 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0