[2024-11-05 10:32:18.327703] Starting SPDK v25.01-pre git sha1 6b98809f9 / DPDK 24.03.0 initialization... [2024-11-05 10:32:18.327968] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid924645 ] Set seed to 1730799138321014 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-05 10:32:18.449874] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-05 10:32:18.551553] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-05 10:32:18.551604] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 924645' to capture a snapshot of events at runtime. [2024-11-05 10:32:18.551615] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-05 10:32:18.551625] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-05 10:32:18.551633] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid924645 for offline analysis/debug. [2024-11-05 10:32:18.552969] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 5 10:32:24 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/05-10:32:33 ... thread 0: (1000000,1000000) ops and (114063.7,114063.7) ops/second in (8.767032,8.767032) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/18 3.11 GB 6.3 0.7 0.0 0.7 1.6 0.9 0.0 1.9 75.0 162.2 10.06 5.44 17 0.592 766K 3539 0.0 0.0 L1 1/1 106.27 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 954.55 MB 1.0 1.8 0.8 1.0 1.8 0.8 0.0 2.3 164.8 162.4 11.28 8.48 7 1.611 851K 4487 0.0 0.0 L4 130/0 9.44 GB 1.0 4.7 1.1 3.5 4.3 0.7 0.4 3.9 148.8 136.3 32.03 19.81 13 2.464 811K 201 0.0 0.0 L5 136/0 11.01 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 301/19 24.60 GB 0.0 7.2 1.9 5.3 7.6 2.3 1.6 8.9 138.3 146.7 53.37 33.73 37 1.443 2429K 8227 0.0 0.0 Int 0/0 0.00 KB 0.0 7.2 1.9 5.3 7.6 2.3 1.6 8.9 138.3 146.7 53.37 33.73 37 1.443 2429K 8227 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.2 1.9 5.3 6.8 1.5 0.0 0.0 149.6 140.8 49.34 31.37 23 2.145 2429K 8227 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 218.3 4.04 2.36 14 0.288 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.8 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.64 GB write, 881.82 MB/s write, 7.21 GB read, 831.38 MB/s read, 53.4 seconds Interval compaction: 7.64 GB write, 892.78 MB/s write, 7.21 GB read, 841.72 MB/s read, 53.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 0, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 232044 Average: 87.0044 StdDev: 345.94 Min: 1 Median: 1.9345 Max: 19449 Percentiles: P50: 1.93 P75: 4.05 P99: 1471.02 P99.9: 3956.70 P99.99: 5406.33 ------------------------------------------------------ [ 0, 1 ] 21817 9.402% 9.402% ## ( 1, 2 ] 100811 43.445% 52.847% ######### ( 2, 3 ] 36067 15.543% 68.390% ### ( 3, 4 ] 14988 6.459% 74.849% # ( 4, 6 ] 14152 6.099% 80.948% # ( 6, 10 ] 3859 1.663% 82.611% ( 10, 15 ] 551 0.237% 82.849% ( 15, 22 ] 83 0.036% 82.884% ( 22, 34 ] 9 0.004% 82.888% ( 34, 51 ] 4 0.002% 82.890% ( 51, 76 ] 4 0.002% 82.892% ( 76, 110 ] 669 0.288% 83.180% ( 110, 170 ] 9813 4.229% 87.409% # ( 170, 250 ] 10427 4.494% 91.902% # ( 250, 380 ] 4916 2.119% 94.021% ( 380, 580 ] 4413 1.902% 95.923% ( 580, 870 ] 3983 1.716% 97.639% ( 870, 1300 ] 2797 1.205% 98.845% ( 1300, 1900 ] 1265 0.545% 99.390% ( 1900, 2900 ] 781 0.337% 99.726% ( 2900, 4400 ] 572 0.247% 99.973% ( 4400, 6600 ] 87 0.037% 100.010% ( 6600, 9900 ] 25 0.011% 100.021% ( 9900, 14000 ] 17 0.007% 100.028% ( 14000, 22000 ] 5 0.002% 100.031% ** Level 1 read latency histogram (micros): Count: 261 Average: 638.1379 StdDev: 1134.98 Min: 95 Median: 251.9118 Max: 10334 Percentiles: P50: 251.91 P75: 658.30 P99: 6152.67 P99.9: 10334.00 P99.99: 10334.00 ------------------------------------------------------ ( 76, 110 ] 5 1.916% 1.916% ( 110, 170 ] 60 22.989% 24.904% ##### ( 170, 250 ] 65 24.904% 49.808% ##### ( 250, 380 ] 34 13.027% 62.835% ### ( 380, 580 ] 25 9.579% 72.414% ## ( 580, 870 ] 25 9.579% 81.992% ## ( 870, 1300 ] 23 8.812% 90.805% ## ( 1300, 1900 ] 10 3.831% 94.636% # ( 1900, 2900 ] 4 1.533% 96.169% ( 2900, 4400 ] 5 1.916% 98.084% ( 4400, 6600 ] 3 1.149% 99.234% ( 6600, 9900 ] 1 0.383% 99.617% ( 9900, 14000 ] 1 0.383% 100.000% ** Level 2 read latency histogram (micros): Count: 107624 Average: 12.4483 StdDev: 144.17 Min: 1 Median: 2.1462 Max: 10432 Percentiles: P50: 2.15 P75: 3.17 P99: 14.66 P99.9: 1517.38 P99.99: 2758.52 ------------------------------------------------------ [ 0, 1 ] 1326 1.232% 1.232% ( 1, 2 ] 48225 44.809% 46.041% ######### ( 2, 3 ] 29140 27.076% 73.117% ##### ( 3, 4 ] 11627 10.803% 83.920% ## ( 4, 6 ] 12454 11.572% 95.492% ## ( 6, 10 ] 3256 3.025% 98.517% # ( 10, 15 ] 558 0.518% 99.036% ( 15, 22 ] 75 0.070% 99.105% ( 22, 34 ] 11 0.010% 99.115% ( 34, 51 ] 6 0.006% 99.121% ( 51, 76 ] 6 0.006% 99.127% ( 76, 110 ] 1 0.001% 99.128% ( 110, 170 ] 21 0.020% 99.147% ( 170, 250 ] 73 0.068% 99.215% ( 250, 380 ] 148 0.138% 99.352% ( 380, 580 ] 198 0.184% 99.536% ( 580, 870 ] 223 0.207% 99.744% ( 870, 1300 ] 147 0.137% 99.880% ( 1300, 1900 ] 59 0.055% 99.935% ( 1900, 2900 ] 69 0.064% 99.999% ( 2900, 4400 ] 45 0.042% 100.041% ( 4400, 6600 ] 16 0.015% 100.056% ( 6600, 9900 ] 3 0.003% 100.059% ( 9900, 14000 ] 1 0.001% 100.059% ** Level 3 read latency histogram (micros): Count: 537333 Average: 13.9523 StdDev: 135.66 Min: 1 Median: 2.0758 Max: 14045 Percentiles: P50: 2.08 P75: 2.99 P99: 222.35 P99.9: 1254.03 P99.99: 1780.34 ------------------------------------------------------ [ 0, 1 ] 9698 1.805% 1.805% ( 1, 2 ] 247867 46.129% 47.934% ######### ( 2, 3 ] 146547 27.273% 75.207% ##### ( 3, 4 ] 51592 9.601% 84.808% ## ( 4, 6 ] 56704 10.553% 95.361% ## ( 6, 10 ] 14935 2.779% 98.141% # ( 10, 15 ] 2529 0.471% 98.611% ( 15, 22 ] 338 0.063% 98.674% ( 22, 34 ] 34 0.006% 98.681% ( 34, 51 ] 40 0.007% 98.688% ( 51, 76 ] 26 0.005% 98.693% ( 76, 110 ] 75 0.014% 98.707% ( 110, 170 ] 866 0.161% 98.868% ( 170, 250 ] 1083 0.202% 99.070% ( 250, 380 ] 951 0.177% 99.247% ( 380, 580 ] 1211 0.225% 99.472% ( 580, 870 ] 1403 0.261% 99.733% ( 870, 1300 ] 1004 0.187% 99.920% ( 1300, 1900 ] 470 0.087% 100.007% ( 1900, 2900 ] 310 0.058% 100.065% ( 2900, 4400 ] 245 0.046% 100.111% ( 4400, 6600 ] 49 0.009% 100.120% ( 6600, 9900 ] 3 0.001% 100.120% ( 14000, 22000 ] 2 0.000% 100.121% ** Level 4 read latency histogram (micros): Count: 916891 Average: 22.0974 StdDev: 174.41 Min: 0 Median: 2.1934 Max: 19547 Percentiles: P50: 2.19 P75: 3.28 P99: 444.38 P99.9: 1185.55 P99.99: 1333.64 ------------------------------------------------------ [ 0, 1 ] 16309 1.779% 1.779% ( 1, 2 ] 393748 42.944% 44.723% ######### ( 2, 3 ] 250219 27.290% 72.012% ##### ( 3, 4 ] 96519 10.527% 82.539% ## ( 4, 6 ] 102877 11.220% 93.759% ## ( 6, 10 ] 27208 2.967% 96.727% # ( 10, 15 ] 4830 0.527% 97.254% ( 15, 22 ] 779 0.085% 97.339% ( 22, 34 ] 55 0.006% 97.345% ( 34, 51 ] 47 0.005% 97.350% ( 51, 76 ] 47 0.005% 97.355% ( 76, 110 ] 372 0.041% 97.395% ( 110, 170 ] 5014 0.547% 97.942% ( 170, 250 ] 5426 0.592% 98.534% ( 250, 380 ] 3119 0.340% 98.874% ( 380, 580 ] 3582 0.391% 99.265% ( 580, 870 ] 3761 0.410% 99.675% ( 870, 1300 ] 2810 0.306% 99.982% ( 1300, 1900 ] 1379 0.150% 100.132% ( 1900, 2900 ] 908 0.099% 100.231% ( 2900, 4400 ] 698 0.076% 100.307% ( 4400, 6600 ] 109 0.012% 100.319% ( 6600, 9900 ] 15 0.002% 100.321% ( 9900, 14000 ] 2 0.000% 100.321% ( 14000, 22000 ] 3 0.000% 100.321% ** Level 5 read latency histogram (micros): Count: 20923 Average: 521.6050 StdDev: 667.27 Min: 84 Median: 250.8445 Max: 7681 Percentiles: P50: 250.84 P75: 617.87 P99: 3809.55 P99.9: 6124.19 P99.99: 7681.00 ------------------------------------------------------ ( 76, 110 ] 344 1.644% 1.644% ( 110, 170 ] 5151 24.619% 26.263% ##### ( 170, 250 ] 4950 23.658% 49.921% ##### ( 250, 380 ] 2540 12.140% 62.061% ## ( 380, 580 ] 2410 11.518% 73.579% ## ( 580, 870 ] 2276 10.878% 84.457% ## ( 870, 1300 ] 1612 7.704% 92.162% ## ( 1300, 1900 ] 727 3.475% 95.636% # ( 1900, 2900 ] 497 2.375% 98.012% ( 2900, 4400 ] 341 1.630% 99.642% ( 4400, 6600 ] 69 0.330% 99.971% ( 6600, 9900 ] 6 0.029% 100.000% ** DB Stats ** Uptime(secs): 8.9 total, 8.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 110.86 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.857 H:M:S, 54.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 112.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.857 H:M:S, 55.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 330.570 micros/op 12042 ops/sec 20.178 seconds 242996 operations; 11.7 MB/s (61999 of 61999 found) Microseconds per read: Count: 242996 Average: 330.5791 StdDev: 594.06 Min: 2 Median: 219.7361 Max: 33315 Percentiles: P50: 219.74 P75: 329.12 P99: 2414.94 P99.9: 8085.09 P99.99: 21200.07 ------------------------------------------------------ ( 1, 2 ] 2 0.001% 0.001% ( 2, 3 ] 52 0.021% 0.022% ( 3, 4 ] 56 0.023% 0.045% ( 4, 6 ] 87 0.036% 0.081% ( 6, 10 ] 296 0.122% 0.203% ( 10, 15 ] 1559 0.642% 0.844% ( 15, 22 ] 2828 1.164% 2.008% ( 22, 34 ] 4615 1.899% 3.907% ( 34, 51 ] 2338 0.962% 4.870% ( 51, 76 ] 149 0.061% 4.931% ( 76, 110 ] 368 0.151% 5.082% ( 110, 170 ] 46220 19.021% 24.103% #### ( 170, 250 ] 101219 41.655% 65.758% ######## ( 250, 380 ] 36899 15.185% 80.943% ### ( 380, 580 ] 24159 9.942% 90.885% ## ( 580, 870 ] 11028 4.538% 95.423% # ( 870, 1300 ] 5371 2.210% 97.634% ( 1300, 1900 ] 2474 1.018% 98.652% ( 1900, 2900 ] 1643 0.676% 99.328% ( 2900, 4400 ] 994 0.409% 99.737% ( 4400, 6600 ] 333 0.137% 99.874% ( 6600, 9900 ] 140 0.058% 99.932% ( 9900, 14000 ] 103 0.042% 99.974% ( 14000, 22000 ] 43 0.018% 99.992% ( 22000, 33000 ] 19 0.008% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 4630867 rocksdb.bloom.filter.full.positive COUNT : 288031 rocksdb.bloom.filter.full.true.positive COUNT : 242531 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 465 rocksdb.memtable.miss COUNT : 242531 rocksdb.l0.hit COUNT : 39569 rocksdb.l1.hit COUNT : 1107 rocksdb.l2andup.hit COUNT : 201855 rocksdb.compaction.key.drop.new COUNT : 476662 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 1799228 rocksdb.number.keys.read COUNT : 242996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 1856803296 rocksdb.bytes.read COUNT : 242996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 416 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 13196106 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 10178899489 rocksdb.compact.write.bytes COUNT : 9684392378 rocksdb.flush.write.bytes COUNT : 1847204116 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 20 rocksdb.number.superversion_acquires COUNT : 368 rocksdb.number.superversion_releases COUNT : 351 rocksdb.number.superversion_cleanups COUNT : 89 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 1834701824 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2892800 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 10958301734 rocksdb.non.last.level.read.count COUNT : 2618674 rocksdb.block.checksum.compute.count COUNT : 2758235 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 218.977510 P95 : 842.427790 P99 : 2414.327450 P100 : 32903.000000 COUNT : 242996 SUM : 80099218 rocksdb.db.write.micros P50 : 1.544818 P95 : 4.727403 P99 : 10.727018 P100 : 7369.000000 COUNT : 1799228 SUM : 17704259 rocksdb.compaction.times.micros P50 : 1783333.333333 P95 : 4230000.000000 P99 : 4309910.000000 P100 : 4309910.000000 COUNT : 27 SUM : 56461122 rocksdb.compaction.times.cpu_micros P50 : 1139285.714286 P95 : 2841666.666667 P99 : 3169628.000000 P100 : 3169628.000000 COUNT : 27 SUM : 37305238 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 977.500000 P95 : 65000.000000 P99 : 299027.000000 P100 : 299027.000000 COUNT : 28 SUM : 391735 rocksdb.compaction.outfile.sync.micros P50 : 4250.000000 P95 : 107550.000000 P99 : 168950.000000 P100 : 646523.000000 COUNT : 107 SUM : 2490935 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 210.000000 P95 : 1289.250000 P99 : 3286.000000 P100 : 3286.000000 COUNT : 62 SUM : 26091 rocksdb.table.open.io.micros P50 : 6959.183673 P95 : 13872.758621 P99 : 39897.142857 P100 : 43637.000000 COUNT : 416 SUM : 3022420 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.985818 P95 : 11.697982 P99 : 302.891163 P100 : 19460.000000 COUNT : 2466480 SUM : 45369937 rocksdb.read.block.get.micros P50 : 172.409542 P95 : 711.017918 P99 : 1857.535155 P100 : 19550.000000 COUNT : 291604 SUM : 72752025 rocksdb.write.raw.block.micros P50 : 0.526766 P95 : 1.026002 P99 : 3.514938 P100 : 20647.000000 COUNT : 2795120 SUM : 6559236 rocksdb.numfiles.in.singlecompaction P50 : 3.392857 P95 : 9.000000 P99 : 13.250000 P100 : 15.000000 COUNT : 35 SUM : 152 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563239 P95 : 1176.043414 P99 : 2513.871443 P100 : 7361.000000 COUNT : 89893 SUM : 13203878 rocksdb.sst.read.micros P50 : 1.999153 P95 : 212.084933 P99 : 690.311988 P100 : 19547.000000 COUNT : 2619124 SUM : 110407167 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 242996 SUM : 242996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 1799228 SUM : 1856803296 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 232222.222222 P95 : 437000.000000 P99 : 543400.000000 P100 : 567624.000000 COUNT : 28 SUM : 6831061 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 113 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0