[2024-11-17 11:07:15.463374] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 22.11.4 initialization... [2024-11-17 11:07:15.463647] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid191844 ] Set seed to 1731838035456593 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-17 11:07:15.581374] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-17 11:07:15.602886] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-17 11:07:15.602929] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 191844' to capture a snapshot of events at runtime. [2024-11-17 11:07:15.602939] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-17 11:07:15.602949] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-17 11:07:15.602957] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid191844 for offline analysis/debug. [2024-11-17 11:07:15.603521] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Nov 17 11:07:19 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/17-11:07:23 ... thread 0: (1000000,1000000) ops and (247360.7,247360.7) ops/second in (4.042680,4.042680) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 3.10 GB 62.9 0.6 0.0 0.6 1.4 0.9 0.0 1.6 100.5 256.6 5.64 4.66 15 0.376 575K 644 0.0 0.0 L1 17/17 1.75 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 67.71 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 977.34 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 169/0 9.60 GB 1.0 1.2 0.5 0.7 1.2 0.4 0.0 2.5 155.1 152.4 7.82 5.93 4 1.955 0 0 0.0 0.0 L5 1120/0 92.03 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1335/27 107.50 GB 0.0 1.7 0.5 1.3 2.6 1.3 1.3 3.0 132.2 196.1 13.47 10.59 19 0.709 575K 644 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 0.5 1.3 2.6 1.3 1.3 3.0 132.2 196.1 13.47 10.59 19 0.709 575K 644 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 0.5 1.3 1.7 0.4 0.0 0.0 177.5 175.3 10.03 8.08 6 1.672 575K 644 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 257.0 3.43 2.51 13 0.264 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.2 total, 4.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.58 GB write, 621.88 MB/s write, 1.74 GB read, 419.34 MB/s read, 13.5 seconds Interval compaction: 2.58 GB write, 652.84 MB/s write, 1.74 GB read, 440.22 MB/s read, 13.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 1, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 357045 Average: 5.5555 StdDev: 63.63 Min: 1 Median: 1.6554 Max: 11451 Percentiles: P50: 1.66 P75: 2.27 P99: 13.85 P99.9: 510.48 P99.99: 825.27 ------------------------------------------------------ [ 0, 1 ] 39130 10.959% 10.959% ## ( 1, 2 ] 212673 59.565% 70.524% ############ ( 2, 3 ] 59589 16.689% 87.214% ### ( 3, 4 ] 19200 5.377% 92.591% # ( 4, 6 ] 16348 4.579% 97.170% # ( 6, 10 ] 5921 1.658% 98.828% ( 10, 15 ] 798 0.224% 99.052% ( 15, 22 ] 145 0.041% 99.092% ( 22, 34 ] 61 0.017% 99.109% ( 34, 51 ] 19 0.005% 99.115% ( 51, 76 ] 5 0.001% 99.116% ( 76, 110 ] 320 0.090% 99.206% ( 110, 170 ] 1134 0.318% 99.523% ( 170, 250 ] 681 0.191% 99.714% ( 250, 380 ] 419 0.117% 99.831% ( 380, 580 ] 377 0.106% 99.937% ( 580, 870 ] 225 0.063% 100.000% ( 870, 1300 ] 98 0.027% 100.027% ( 1300, 1900 ] 42 0.012% 100.039% ( 1900, 2900 ] 21 0.006% 100.045% ( 2900, 4400 ] 7 0.002% 100.047% ( 4400, 6600 ] 3 0.001% 100.048% ( 6600, 9900 ] 5 0.001% 100.049% ( 9900, 14000 ] 3 0.001% 100.050% ** Level 1 read latency histogram (micros): Count: 384 Average: 758.5964 StdDev: 1647.45 Min: 83 Median: 240.5263 Max: 11204 Percentiles: P50: 240.53 P75: 537.45 P99: 9225.33 P99.9: 11204.00 P99.99: 11204.00 ------------------------------------------------------ ( 76, 110 ] 29 7.552% 7.552% ## ( 110, 170 ] 96 25.000% 32.552% ##### ( 170, 250 ] 76 19.792% 52.344% #### ( 250, 380 ] 50 13.021% 65.365% ### ( 380, 580 ] 47 12.240% 77.604% ## ( 580, 870 ] 33 8.594% 86.198% ## ( 870, 1300 ] 11 2.865% 89.062% # ( 1300, 1900 ] 8 2.083% 91.146% ( 1900, 2900 ] 14 3.646% 94.792% # ( 2900, 4400 ] 4 1.042% 95.833% ( 4400, 6600 ] 5 1.302% 97.135% ( 6600, 9900 ] 9 2.344% 99.479% ( 9900, 14000 ] 2 0.521% 100.000% ** Level 2 read latency histogram (micros): Count: 22 Average: 471.8636 StdDev: 624.09 Min: 124 Median: 210.0000 Max: 2800 Percentiles: P50: 210.00 P75: 480.00 P99: 2680.00 P99.9: 2800.00 P99.99: 2800.00 ------------------------------------------------------ ( 110, 170 ] 9 40.909% 40.909% ######## ( 170, 250 ] 4 18.182% 59.091% #### ( 250, 380 ] 1 4.545% 63.636% # ( 380, 580 ] 5 22.727% 86.364% ##### ( 870, 1300 ] 1 4.545% 90.909% # ( 1300, 1900 ] 1 4.545% 95.455% # ( 1900, 2900 ] 1 4.545% 100.000% # ** Level 3 read latency histogram (micros): Count: 225 Average: 481.1467 StdDev: 555.63 Min: 95 Median: 252.0312 Max: 2845 Percentiles: P50: 252.03 P75: 525.59 P99: 2675.00 P99.9: 2845.00 P99.99: 2845.00 ------------------------------------------------------ ( 76, 110 ] 3 1.333% 1.333% ( 110, 170 ] 59 26.222% 27.556% ##### ( 170, 250 ] 50 22.222% 49.778% #### ( 250, 380 ] 32 14.222% 64.000% ### ( 380, 580 ] 34 15.111% 79.111% ### ( 580, 870 ] 17 7.556% 86.667% ## ( 870, 1300 ] 10 4.444% 91.111% # ( 1300, 1900 ] 10 4.444% 95.556% # ( 1900, 2900 ] 10 4.444% 100.000% # ** Level 4 read latency histogram (micros): Count: 122768 Average: 19.6322 StdDev: 157.36 Min: 1 Median: 1.9413 Max: 10518 Percentiles: P50: 1.94 P75: 2.94 P99: 492.18 P99.9: 1608.49 P99.99: 2042.93 ------------------------------------------------------ [ 0, 1 ] 4723 3.847% 3.847% # ( 1, 2 ] 60193 49.030% 52.877% ########## ( 2, 3 ] 28776 23.439% 76.316% ##### ( 3, 4 ] 11215 9.135% 85.451% ## ( 4, 6 ] 10502 8.554% 94.006% ## ( 6, 10 ] 3599 2.932% 96.937% # ( 10, 15 ] 485 0.395% 97.332% ( 15, 22 ] 117 0.095% 97.428% ( 22, 34 ] 39 0.032% 97.459% ( 34, 51 ] 17 0.014% 97.473% ( 51, 76 ] 11 0.009% 97.482% ( 76, 110 ] 137 0.112% 97.594% ( 110, 170 ] 567 0.462% 98.056% ( 170, 250 ] 464 0.378% 98.434% ( 250, 380 ] 416 0.339% 98.772% ( 380, 580 ] 498 0.406% 99.178% ( 580, 870 ] 466 0.380% 99.558% ( 870, 1300 ] 321 0.261% 99.819% ( 1300, 1900 ] 193 0.157% 99.976% ( 1900, 2900 ] 117 0.095% 100.072% ( 2900, 4400 ] 52 0.042% 100.114% ( 4400, 6600 ] 11 0.009% 100.123% ( 6600, 9900 ] 2 0.002% 100.125% ( 9900, 14000 ] 2 0.002% 100.126% ** Level 5 read latency histogram (micros): Count: 18248 Average: 606.7642 StdDev: 904.70 Min: 80 Median: 244.1124 Max: 15107 Percentiles: P50: 244.11 P75: 580.00 P99: 4373.17 P99.9: 6568.30 P99.99: 12872.77 ------------------------------------------------------ ( 76, 110 ] 1190 6.521% 6.521% # ( 110, 170 ] 5001 27.406% 33.927% ##### ( 170, 250 ] 3166 17.350% 51.277% ### ( 250, 380 ] 2261 12.390% 63.667% ## ( 380, 580 ] 2068 11.333% 75.000% ## ( 580, 870 ] 1389 7.612% 82.612% ## ( 870, 1300 ] 906 4.965% 87.577% # ( 1300, 1900 ] 707 3.874% 91.451% # ( 1900, 2900 ] 802 4.395% 95.846% # ( 2900, 4400 ] 586 3.211% 99.057% # ( 4400, 6600 ] 156 0.855% 99.912% ( 6600, 9900 ] 12 0.066% 99.978% ( 9900, 14000 ] 3 0.016% 99.995% ( 14000, 22000 ] 1 0.005% 100.000% ** DB Stats ** Uptime(secs): 4.2 total, 4.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 231.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.331 H:M:S, 7.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 243.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.331 H:M:S, 8.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 196.662 micros/op 20317 ops/sec 60.095 seconds 1220996 operations; 19.7 MB/s (304999 of 304999 found) Microseconds per read: Count: 1220996 Average: 196.6646 StdDev: 366.72 Min: 5 Median: 170.4674 Max: 60059 Percentiles: P50: 170.47 P75: 221.06 P99: 542.36 P99.9: 4349.18 P99.99: 18280.97 ------------------------------------------------------ ( 4, 6 ] 72 0.006% 0.006% ( 6, 10 ] 276 0.023% 0.029% ( 10, 15 ] 36 0.003% 0.031% ( 15, 22 ] 160 0.013% 0.045% ( 22, 34 ] 15571 1.275% 1.320% ( 34, 51 ] 2026 0.166% 1.486% ( 51, 76 ] 200 0.016% 1.502% ( 76, 110 ] 185 0.015% 1.517% ( 110, 170 ] 589152 48.252% 49.769% ########## ( 170, 250 ] 482647 39.529% 89.298% ######## ( 250, 380 ] 98608 8.076% 97.374% ## ( 380, 580 ] 24456 2.003% 99.377% ( 580, 870 ] 4782 0.392% 99.769% ( 870, 1300 ] 910 0.075% 99.843% ( 1300, 1900 ] 232 0.019% 99.862% ( 1900, 2900 ] 234 0.019% 99.881% ( 2900, 4400 ] 236 0.019% 99.901% ( 4400, 6600 ] 377 0.031% 99.932% ( 6600, 9900 ] 339 0.028% 99.959% ( 9900, 14000 ] 285 0.023% 99.983% ( 14000, 22000 ] 168 0.014% 99.996% ( 22000, 33000 ] 38 0.003% 100.000% ( 33000, 50000 ] 5 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 13626137 rocksdb.bloom.filter.full.positive COUNT : 1353808 rocksdb.bloom.filter.full.true.positive COUNT : 1220621 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 375 rocksdb.memtable.miss COUNT : 1220621 rocksdb.l0.hit COUNT : 43052 rocksdb.l1.hit COUNT : 21419 rocksdb.l2andup.hit COUNT : 1156150 rocksdb.compaction.key.drop.new COUNT : 61086 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 1375840 rocksdb.number.keys.read COUNT : 1220996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 1419866880 rocksdb.bytes.read COUNT : 1220996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1376 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 53261847 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 6137783900 rocksdb.compact.write.bytes COUNT : 6085318737 rocksdb.flush.write.bytes COUNT : 1387323538 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 47 rocksdb.number.superversion_acquires COUNT : 216 rocksdb.number.superversion_releases COUNT : 203 rocksdb.number.superversion_cleanups COUNT : 53 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 1376052224 rocksdb.memtable.garbage.bytes.at.flush COUNT : 456704 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 11497937826 rocksdb.non.last.level.read.count COUNT : 2633458 rocksdb.block.checksum.compute.count COUNT : 2852980 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 169.011755 P95 : 341.044054 P99 : 541.455600 P100 : 60056.000000 COUNT : 1220996 SUM : 238773715 rocksdb.db.write.micros P50 : 1.781987 P95 : 9.691459 P99 : 1293.731123 P100 : 5572.000000 COUNT : 1375840 SUM : 57857706 rocksdb.compaction.times.micros P50 : 1725000.000000 P95 : 3078677.000000 P99 : 3078677.000000 P100 : 3078677.000000 COUNT : 9 SUM : 15018450 rocksdb.compaction.times.cpu_micros P50 : 1287500.000000 P95 : 3047766.000000 P99 : 3047766.000000 P100 : 3047766.000000 COUNT : 9 SUM : 13001840 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 841.000000 P95 : 9900.000000 P99 : 103000.000000 P100 : 104584.000000 COUNT : 20 SUM : 136133 rocksdb.compaction.outfile.sync.micros P50 : 1525.000000 P95 : 36683.333333 P99 : 42103.000000 P100 : 42103.000000 COUNT : 47 SUM : 263401 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 274.375000 P95 : 1405.000000 P99 : 1490.000000 P100 : 1490.000000 COUNT : 33 SUM : 13525 rocksdb.table.open.io.micros P50 : 6057.905544 P95 : 13436.250000 P99 : 19753.469388 P100 : 21939.000000 COUNT : 1376 SUM : 9236647 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.872674 P95 : 160.198977 P99 : 235.852618 P100 : 11137.000000 COUNT : 1489324 SUM : 46409067 rocksdb.read.block.get.micros P50 : 139.241493 P95 : 233.837866 P99 : 442.401420 P100 : 26800.000000 COUNT : 1362295 SUM : 199127229 rocksdb.write.raw.block.micros P50 : 0.666013 P95 : 1.935970 P99 : 4.933433 P100 : 15246.000000 COUNT : 1810169 SUM : 4711191 rocksdb.numfiles.in.singlecompaction P50 : 4.000000 P95 : 23.000000 P99 : 23.000000 P100 : 23.000000 COUNT : 14 SUM : 82 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.594676 P95 : 2032.864833 P99 : 2726.632775 P100 : 5006.000000 COUNT : 231996 SUM : 53292735 rocksdb.sst.read.micros P50 : 100.600533 P95 : 201.253232 P99 : 352.778176 P100 : 15107.000000 COUNT : 2633557 SUM : 233030173 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1220996 SUM : 1220996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 1375840 SUM : 1419866880 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 223333.333333 P95 : 380000.000000 P99 : 480143.000000 P100 : 480143.000000 COUNT : 20 SUM : 4936730 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 50 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0