[2024-11-20 21:06:47.022536] Starting SPDK v25.01-pre git sha1 557f022f6 / DPDK 24.11.0-rc3 initialization... [2024-11-20 21:06:47.022682] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4086728 ] Set seed to 1732133207019001 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 21:06:47.188294] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.11.0-rc3 is used. There is no support for it in SPDK. Enabled only for validation. [2024-11-20 21:06:47.239313] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 21:06:47.262542] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 21:06:47.262581] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 4086728' to capture a snapshot of events at runtime. [2024-11-20 21:06:47.262593] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 21:06:47.262603] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 21:06:47.262613] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid4086728 for offline analysis/debug. [2024-11-20 21:06:47.263157] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 21:06:51 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-21:06:57 ... thread 0: (1000000,1000000) ops and (167354.3,167354.3) ops/second in (5.975347,5.975347) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 3.12 GB 62.9 0.5 0.0 0.5 1.4 0.9 0.0 1.6 83.4 229.2 6.04 4.28 15 0.403 511K 475 0.0 0.0 L1 15/15 1.83 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 20/0 984.62 MB 1.0 1.7 1.0 0.7 1.7 1.0 0.0 1.7 173.0 172.0 9.97 7.97 8 1.246 298K 0 0.0 0.0 L4 153/0 9.60 GB 1.0 2.0 1.0 1.0 1.9 1.0 0.0 2.0 134.0 132.0 15.10 9.09 16 0.944 866K 0 0.0 0.0 L5 1112/0 91.41 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1317/29 106.93 GB 0.0 4.2 2.0 2.1 5.0 2.8 1.0 5.8 136.6 163.7 31.11 21.34 39 0.798 1676K 475 0.0 0.0 Int 0/0 0.00 KB 0.0 4.2 2.0 2.1 5.0 2.8 1.0 5.8 136.6 163.7 31.11 21.34 39 0.798 1676K 475 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.2 2.0 2.1 4.1 2.0 0.0 0.0 156.2 154.7 27.22 18.96 26 1.047 1676K 475 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 226.4 3.90 2.38 13 0.300 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.97 GB write, 827.99 MB/s write, 4.15 GB read, 691.15 MB/s read, 31.1 seconds Interval compaction: 4.97 GB write, 852.11 MB/s write, 4.15 GB read, 711.28 MB/s read, 31.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 8, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 8, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 309503 Average: 16.0199 StdDev: 148.02 Min: 0 Median: 1.7753 Max: 13139 Percentiles: P50: 1.78 P75: 2.74 P99: 318.33 P99.9: 1599.99 P99.99: 3210.99 ------------------------------------------------------ [ 0, 1 ] 33788 10.917% 10.917% ## ( 1, 2 ] 156027 50.412% 61.329% ########## ( 2, 3 ] 57198 18.481% 79.810% #### ( 3, 4 ] 23717 7.663% 87.472% ## ( 4, 6 ] 21685 7.006% 94.479% # ( 6, 10 ] 5994 1.937% 96.416% ( 10, 15 ] 1030 0.333% 96.748% ( 15, 22 ] 169 0.055% 96.803% ( 22, 34 ] 47 0.015% 96.818% ( 34, 51 ] 18 0.006% 96.824% ( 51, 76 ] 15 0.005% 96.829% ( 76, 110 ] 1052 0.340% 97.169% ( 110, 170 ] 3467 1.120% 98.289% ( 170, 250 ] 1690 0.546% 98.835% ( 250, 380 ] 974 0.315% 99.150% ( 380, 580 ] 1001 0.323% 99.473% ( 580, 870 ] 704 0.227% 99.700% ( 870, 1300 ] 510 0.165% 99.865% ( 1300, 1900 ] 217 0.070% 99.935% ( 1900, 2900 ] 146 0.047% 99.983% ( 2900, 4400 ] 116 0.037% 100.020% ( 4400, 6600 ] 35 0.011% 100.031% ( 6600, 9900 ] 8 0.003% 100.034% ( 9900, 14000 ] 7 0.002% 100.036% ** Level 1 read latency histogram (micros): Count: 667 Average: 511.3163 StdDev: 1215.64 Min: 83 Median: 187.2358 Max: 12756 Percentiles: P50: 187.24 P75: 378.63 P99: 7477.80 P99.9: 12756.00 P99.99: 12756.00 ------------------------------------------------------ ( 76, 110 ] 71 10.645% 10.645% ## ( 110, 170 ] 236 35.382% 46.027% ####### ( 170, 250 ] 123 18.441% 64.468% #### ( 250, 380 ] 71 10.645% 75.112% ## ( 380, 580 ] 60 8.996% 84.108% ## ( 580, 870 ] 37 5.547% 89.655% # ( 870, 1300 ] 19 2.849% 92.504% # ( 1300, 1900 ] 16 2.399% 94.903% ( 1900, 2900 ] 17 2.549% 97.451% # ( 2900, 4400 ] 6 0.900% 98.351% ( 4400, 6600 ] 3 0.450% 98.801% ( 6600, 9900 ] 5 0.750% 99.550% ( 9900, 14000 ] 3 0.450% 100.000% ** Level 2 read latency histogram (micros): Count: 130423 Average: 6.7695 StdDev: 72.37 Min: 1 Median: 1.9084 Max: 6240 Percentiles: P50: 1.91 P75: 2.92 P99: 9.88 P99.9: 582.93 P99.99: 801.14 ------------------------------------------------------ [ 0, 1 ] 5038 3.863% 3.863% # ( 1, 2 ] 66240 50.789% 54.651% ########## ( 2, 3 ] 28906 22.163% 76.815% #### ( 3, 4 ] 12749 9.775% 86.590% ## ( 4, 6 ] 12455 9.550% 96.139% ## ( 6, 10 ] 3846 2.949% 99.088% # ( 10, 15 ] 635 0.487% 99.575% ( 15, 22 ] 85 0.065% 99.640% ( 22, 34 ] 26 0.020% 99.660% ( 34, 51 ] 10 0.008% 99.668% ( 51, 76 ] 2 0.002% 99.670% ( 76, 110 ] 13 0.010% 99.680% ( 110, 170 ] 26 0.020% 99.699% ( 170, 250 ] 41 0.031% 99.731% ( 250, 380 ] 85 0.065% 99.796% ( 380, 580 ] 134 0.103% 99.899% ( 580, 870 ] 156 0.120% 100.018% ( 870, 1300 ] 106 0.081% 100.100% ( 1300, 1900 ] 51 0.039% 100.139% ( 1900, 2900 ] 21 0.016% 100.155% ( 2900, 4400 ] 6 0.005% 100.159% ( 4400, 6600 ] 5 0.004% 100.163% ** Level 3 read latency histogram (micros): Count: 420425 Average: 6.1502 StdDev: 88.75 Min: 1 Median: 1.8897 Max: 9549 Percentiles: P50: 1.89 P75: 2.90 P99: 9.26 P99.9: 237.93 P99.99: 531.27 ------------------------------------------------------ [ 0, 1 ] 14690 3.494% 3.494% # ( 1, 2 ] 219752 52.269% 55.763% ########## ( 2, 3 ] 90076 21.425% 77.188% #### ( 3, 4 ] 43617 10.375% 87.563% ## ( 4, 6 ] 41135 9.784% 97.347% ## ( 6, 10 ] 8517 2.026% 99.373% ( 10, 15 ] 1448 0.344% 99.717% ( 15, 22 ] 231 0.055% 99.772% ( 22, 34 ] 43 0.010% 99.782% ( 34, 51 ] 26 0.006% 99.788% ( 51, 76 ] 42 0.010% 99.798% ( 76, 110 ] 54 0.013% 99.811% ( 110, 170 ] 208 0.049% 99.861% ( 170, 250 ] 195 0.046% 99.907% ( 250, 380 ] 175 0.042% 99.949% ( 380, 580 ] 230 0.055% 100.003% ( 580, 870 ] 232 0.055% 100.059% ( 870, 1300 ] 169 0.040% 100.099% ( 1300, 1900 ] 94 0.022% 100.121% ( 1900, 2900 ] 66 0.016% 100.137% ( 2900, 4400 ] 79 0.019% 100.156% ( 4400, 6600 ] 32 0.008% 100.163% ( 6600, 9900 ] 8 0.002% 100.165% ** Level 4 read latency histogram (micros): Count: 257229 Average: 22.6195 StdDev: 217.53 Min: 1 Median: 1.9237 Max: 12916 Percentiles: P50: 1.92 P75: 2.98 P99: 432.58 P99.9: 2440.34 P99.99: 3266.01 ------------------------------------------------------ [ 0, 1 ] 7246 2.817% 2.817% # ( 1, 2 ] 131395 51.081% 53.898% ########## ( 2, 3 ] 55316 21.505% 75.402% #### ( 3, 4 ] 25721 9.999% 85.402% ## ( 4, 6 ] 24464 9.511% 94.912% ## ( 6, 10 ] 6526 2.537% 97.449% # ( 10, 15 ] 1197 0.465% 97.915% ( 15, 22 ] 162 0.063% 97.978% ( 22, 34 ] 35 0.014% 97.991% ( 34, 51 ] 19 0.007% 97.999% ( 51, 76 ] 28 0.011% 98.010% ( 76, 110 ] 274 0.107% 98.116% ( 110, 170 ] 964 0.375% 98.491% ( 170, 250 ] 615 0.239% 98.730% ( 250, 380 ] 522 0.203% 98.933% ( 380, 580 ] 657 0.255% 99.188% ( 580, 870 ] 711 0.276% 99.465% ( 870, 1300 ] 580 0.225% 99.690% ( 1300, 1900 ] 362 0.141% 99.831% ( 1900, 2900 ] 329 0.128% 99.959% ( 2900, 4400 ] 329 0.128% 100.087% ( 4400, 6600 ] 109 0.042% 100.129% ( 6600, 9900 ] 17 0.007% 100.136% ( 9900, 14000 ] 3 0.001% 100.137% ** Level 5 read latency histogram (micros): Count: 27186 Average: 615.2816 StdDev: 1005.73 Min: 75 Median: 218.7648 Max: 12269 Percentiles: P50: 218.76 P75: 573.80 P99: 5352.18 P99.9: 8688.84 P99.99: 11850.42 ------------------------------------------------------ ( 51, 76 ] 2 0.007% 0.007% ( 76, 110 ] 2376 8.740% 8.747% ## ( 110, 170 ] 8639 31.777% 40.525% ###### ( 170, 250 ] 4226 15.545% 56.069% ### ( 250, 380 ] 2567 9.442% 65.512% ## ( 380, 580 ] 2662 9.792% 75.303% ## ( 580, 870 ] 2057 7.566% 82.870% ## ( 870, 1300 ] 1435 5.278% 88.148% # ( 1300, 1900 ] 939 3.454% 91.602% # ( 1900, 2900 ] 909 3.344% 94.946% # ( 2900, 4400 ] 942 3.465% 98.411% # ( 4400, 6600 ] 370 1.361% 99.772% ( 6600, 9900 ] 55 0.202% 99.974% ( 9900, 14000 ] 9 0.033% 100.007% ** DB Stats ** Uptime(secs): 6.2 total, 6.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 160.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.100 H:M:S, 34.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 164.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.100 H:M:S, 35.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 209.173 micros/op 19108 ops/sec 60.184 seconds 1149996 operations; 18.5 MB/s (286999 of 286999 found) Microseconds per read: Count: 1149996 Average: 209.1745 StdDev: 438.28 Min: 2 Median: 168.8620 Max: 65813 Percentiles: P50: 168.86 P75: 227.63 P99: 657.92 P99.9: 6446.13 P99.99: 20200.97 ------------------------------------------------------ ( 1, 2 ] 13 0.001% 0.001% ( 2, 3 ] 35 0.003% 0.004% ( 3, 4 ] 68 0.006% 0.010% ( 4, 6 ] 89 0.008% 0.018% ( 6, 10 ] 437 0.038% 0.056% ( 10, 15 ] 3125 0.272% 0.328% ( 15, 22 ] 3036 0.264% 0.592% ( 22, 34 ] 9393 0.817% 1.408% ( 34, 51 ] 2522 0.219% 1.628% ( 51, 76 ] 216 0.019% 1.646% ( 76, 110 ] 23940 2.082% 3.728% ( 110, 170 ] 542412 47.166% 50.895% ######### ( 170, 250 ] 384817 33.462% 84.357% ####### ( 250, 380 ] 129535 11.264% 95.621% ## ( 380, 580 ] 36505 3.174% 98.795% # ( 580, 870 ] 8758 0.762% 99.557% ( 870, 1300 ] 2063 0.179% 99.736% ( 1300, 1900 ] 652 0.057% 99.793% ( 1900, 2900 ] 540 0.047% 99.840% ( 2900, 4400 ] 464 0.040% 99.880% ( 4400, 6600 ] 243 0.021% 99.901% ( 6600, 9900 ] 464 0.040% 99.942% ( 9900, 14000 ] 392 0.034% 99.976% ( 14000, 22000 ] 209 0.018% 99.994% ( 22000, 33000 ] 62 0.005% 99.999% ( 33000, 50000 ] 5 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 19086900 rocksdb.bloom.filter.full.positive COUNT : 1334937 rocksdb.bloom.filter.full.true.positive COUNT : 1149600 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 396 rocksdb.memtable.miss COUNT : 1149600 rocksdb.l0.hit COUNT : 46404 rocksdb.l1.hit COUNT : 21030 rocksdb.l2andup.hit COUNT : 1082166 rocksdb.compaction.key.drop.new COUNT : 93437 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 1940517 rocksdb.number.keys.read COUNT : 1149996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 2002613544 rocksdb.bytes.read COUNT : 1149996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1407 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 51659777 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 10178504874 rocksdb.compact.write.bytes COUNT : 10096082796 rocksdb.flush.write.bytes COUNT : 1981818088 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 24 rocksdb.number.superversion_acquires COUNT : 377 rocksdb.number.superversion_releases COUNT : 356 rocksdb.number.superversion_cleanups COUNT : 94 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 1965747200 rocksdb.memtable.garbage.bytes.at.flush COUNT : 686080 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 15640700931 rocksdb.non.last.level.read.count COUNT : 3637483 rocksdb.block.checksum.compute.count COUNT : 3814655 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 167.911275 P95 : 372.354803 P99 : 656.150494 P100 : 65811.000000 COUNT : 1149996 SUM : 239477037 rocksdb.db.write.micros P50 : 1.646989 P95 : 6.798364 P99 : 1177.274373 P100 : 602409.000000 COUNT : 1940517 SUM : 57294664 rocksdb.compaction.times.micros P50 : 1017857.142857 P95 : 1845000.000000 P99 : 4395725.000000 P100 : 4395725.000000 COUNT : 31 SUM : 35361469 rocksdb.compaction.times.cpu_micros P50 : 894000.000000 P95 : 1515000.000000 P99 : 4308244.000000 P100 : 4308244.000000 COUNT : 31 SUM : 26949952 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 814.230769 P95 : 8415.000000 P99 : 11713.000000 P100 : 11713.000000 COUNT : 29 SUM : 45941 rocksdb.compaction.outfile.sync.micros P50 : 2344.444444 P95 : 21885.714286 P99 : 109300.000000 P100 : 120204.000000 COUNT : 102 SUM : 720248 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 168.235294 P95 : 3703.571429 P99 : 4256.000000 P100 : 4256.000000 COUNT : 65 SUM : 50990 rocksdb.table.open.io.micros P50 : 7161.909449 P95 : 16165.000000 P99 : 21793.000000 P100 : 28570.000000 COUNT : 1407 SUM : 10705253 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.928803 P95 : 144.479018 P99 : 228.904301 P100 : 12924.000000 COUNT : 2468610 SUM : 59481846 rocksdb.read.block.get.micros P50 : 138.136406 P95 : 242.011050 P99 : 542.568079 P100 : 19312.000000 COUNT : 1344637 SUM : 203537651 rocksdb.write.raw.block.micros P50 : 0.534756 P95 : 1.334971 P99 : 3.446120 P100 : 13634.000000 COUNT : 2925531 SUM : 6992267 rocksdb.numfiles.in.singlecompaction P50 : 2.444444 P95 : 4.400000 P99 : 25.000000 P100 : 25.000000 COUNT : 36 SUM : 129 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.584975 P95 : 1977.471396 P99 : 2715.677346 P100 : 602238.000000 COUNT : 241947 SUM : 51684233 rocksdb.sst.read.micros P50 : 3.575645 P95 : 191.529840 P99 : 387.716222 P100 : 13139.000000 COUNT : 3637516 SUM : 251392765 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1149996 SUM : 1149996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 1940517 SUM : 2002613544 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 218333.333333 P95 : 484500.000000 P99 : 874832.000000 P100 : 874832.000000 COUNT : 29 SUM : 7146141 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 100 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0