[00:32:57] drv: could I have an spdk-18.05 branch on our DPDK fork, please? [00:55:33] *** Joins: travis-ci (~travis-ci@ec2-54-146-14-162.compute-1.amazonaws.com) [00:55:34] (spdk/master) test/nvmf: disable identify_kernel test (Daniel Verkamp) [00:55:34] Diff URL: https://github.com/spdk/spdk/compare/9a9bef0a9aec...4c91e7bf3be4 [00:55:34] *** Parts: travis-ci (~travis-ci@ec2-54-146-14-162.compute-1.amazonaws.com) () [01:00:35] *** Joins: tkulasek (~tkulasek@192.55.54.40) [01:19:35] *** Quits: darsto (~darsto@89-68-112-135.dynamic.chello.pl) (Ping timeout: 260 seconds) [01:24:21] *** Joins: darsto (~darsto@89-68-112-135.dynamic.chello.pl) [01:25:14] *** Quits: Shuhei (caf6fc61@gateway/web/freenode/ip.202.246.252.97) (Ping timeout: 260 seconds) [01:44:19] *** Joins: gila (~gila@5ED74129.cm-7-8b.dynamic.ziggo.nl) [02:12:40] *** Quits: darsto (~darsto@89-68-112-135.dynamic.chello.pl) (Ping timeout: 260 seconds) [02:17:19] *** Joins: darsto (~darsto@89-68-112-135.dynamic.chello.pl) [02:40:25] *** Quits: darsto (~darsto@89-68-112-135.dynamic.chello.pl) (Ping timeout: 252 seconds) [02:45:09] *** Joins: darsto (~darsto@89-68-112-135.dynamic.chello.pl) [02:52:41] *** Quits: gila (~gila@5ED74129.cm-7-8b.dynamic.ziggo.nl) (Ping timeout: 252 seconds) [03:43:09] *** Quits: dlw (~Thunderbi@114.255.44.143) (Quit: dlw) [03:46:34] *** Quits: darsto (~darsto@89-68-112-135.dynamic.chello.pl) (Ping timeout: 252 seconds) [03:46:49] *** Joins: darsto (~darsto@89-68-112-135.dynamic.chello.pl) [04:04:00] *** Joins: johnmeneghini (~johnmeneg@pool-100-0-53-181.bstnma.fios.verizon.net) [04:08:21] *** Quits: johnmeneghini (~johnmeneg@pool-100-0-53-181.bstnma.fios.verizon.net) (Ping timeout: 240 seconds) [05:06:37] *** Joins: johnmeneghini (~johnmeneg@pool-100-0-53-181.bstnma.fios.verizon.net) [05:12:20] *** Quits: darsto (~darsto@89-68-112-135.dynamic.chello.pl) (Ping timeout: 260 seconds) [05:12:39] *** Joins: darsto (~darsto@89-68-112-135.dynamic.chello.pl) [05:17:28] *** Quits: tkulasek (~tkulasek@192.55.54.40) (Remote host closed the connection) [06:05:03] *** Joins: gila (~gila@5ED74129.cm-7-8b.dynamic.ziggo.nl) [08:02:44] Has the community meeting been canceled? [08:07:48] *** Joins: Johnson_ (495dd02d@gateway/web/freenode/ip.73.93.208.45) [08:17:07] *** Joins: tomzawadzki (~tomzawadz@192.55.54.42) [08:55:17] Does assigning large HUGEMEM help in increasing the performance per drive? [08:56:24] Johnson_: nope. SPDK always tries to allocate I/O buffers of fixed size [09:03:42] *** Joins: tkulasek (tkulasek@nat/intel/x-bdltlafvzaefycsr) [09:14:53] darsto: it looks like DPDK 18.05 is not quite done yet, but I'll push a branch once they have tagged it [09:31:45] *** Joins: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) [09:31:46] (spdk/master) bdev_module.h: replace outdated docs with link (Daniel Verkamp) [09:31:47] Diff URL: https://github.com/spdk/spdk/compare/4c91e7bf3be4...868a48e6fd62 [09:31:47] *** Parts: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) () [09:41:40] *** Quits: Johnson_ (495dd02d@gateway/web/freenode/ip.73.93.208.45) (Ping timeout: 260 seconds) [09:45:23] *** Joins: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) [09:45:24] (spdk/master) ocssd: add nvme_ocssd_spec.h (Jakub Radtke) [09:45:24] Diff URL: https://github.com/spdk/spdk/compare/2db633af8006...4906323d47b1 [09:45:24] *** Parts: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) () [09:46:26] kk [10:14:51] *** Joins: Johnson_ (0cda5282@gateway/web/freenode/ip.12.218.82.130) [10:18:53] darsto: Thank you. Any idea why scripts/setup.sh has HUGEMEM as an environment variable? [10:34:02] *** Quits: tkulasek (tkulasek@nat/intel/x-bdltlafvzaefycsr) (Ping timeout: 256 seconds) [11:12:38] *** Joins: travis-ci (~travis-ci@ec2-54-80-51-74.compute-1.amazonaws.com) [11:12:39] (spdk/master) blobstore: Hold the original buffer to free it when realloc() is failed (Shuhei Matsumoto) [11:12:39] Diff URL: https://github.com/spdk/spdk/compare/4906323d47b1...57d93c9ecbba [11:12:39] *** Parts: travis-ci (~travis-ci@ec2-54-80-51-74.compute-1.amazonaws.com) () [11:12:53] *** Joins: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) [11:12:54] (spdk/master) nvme: make response callback after moving completion queue head (Changpeng Liu) [11:12:54] Diff URL: https://github.com/spdk/spdk/compare/57d93c9ecbba...266f37a5a062 [11:12:54] *** Parts: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) () [11:44:18] *** Joins: lhodev_ (~lhodev@inet-hqmc06-o.oracle.com) [11:46:19] *** Quits: lhodev_ (~lhodev@inet-hqmc06-o.oracle.com) (Remote host closed the connection) [11:46:50] *** Joins: lhodev_ (~lhodev@inet-hqmc06-o.oracle.com) [11:48:51] *** Quits: lhodev_ (~lhodev@inet-hqmc06-o.oracle.com) (Remote host closed the connection) [11:49:22] *** Joins: lhodev_ (~lhodev@inet-hqmc06-o.oracle.com) [11:51:25] *** Quits: lhodev_ (~lhodev@inet-hqmc06-o.oracle.com) (Remote host closed the connection) [11:51:59] *** Joins: lhodev_ (~lhodev@inet-hqmc06-o.oracle.com) [11:52:10] *** Joins: gangcao_ (~gangcao@134.134.139.72) [11:53:00] *** Quits: gangcao (~gangcao@134.134.139.72) (*.net *.split) [11:53:00] *** Quits: lhodev (~lhodev@66-90-218-190.dyn.grandenetworks.net) (*.net *.split) [11:53:02] *** gangcao_ is now known as gangcao [12:03:58] Johnson_: the more drives you have, the more memory you require [12:04:23] there's also a possibility to create ramdisks, which also use hugepage memory [12:04:35] (so called malloc bdevs) [12:08:15] I'm not exactly sure how much memory NVMe driver allocates for each drive. 1GB of memory seems to be the very safe and reasonable amount for most - if not all - scenarios [12:08:37] probably @jimharris could give you some details [12:48:05] *** Joins: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) [12:48:06] (spdk/master) bdev/virtio/rpc: fix memleak in construct_virtio_pci_blk_bdev RPC (Dariusz Stojaczyk) [12:48:06] Diff URL: https://github.com/spdk/spdk/compare/266f37a5a062...a3c9b23b84ba [12:48:06] *** Parts: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) () [13:03:15] darsto: Thanks for the details. When I run perf, I get "EAL: No free hugepages reported in hugepages-1048576kB" but the perf still runs. Is normal 4K pages used in this case? And curious to know what is the impact of not using the hugepages? [13:07:37] Johnson_: you *have* to use hugepages, at least for now. The perf above prints it cannot find any 1GB hugepages and probably runs with 2MB ones [13:10:53] dastro: Got it and thanks. What are the impacts of using 2MB over 1GB? [13:23:09] minor performance improvements. bigger hugepage size implies less TLB misses [13:24:20] my macro-benchmarks for SPDK haven't noticed any difference between those two though [13:37:54] *** Joins: travis-ci (~travis-ci@ec2-54-81-11-238.compute-1.amazonaws.com) [13:37:55] (spdk/master) env/dpdk: add support for DPDK 18.05 dynamic memory allocation (Dariusz Stojaczyk) [13:37:55] Diff URL: https://github.com/spdk/spdk/compare/a3c9b23b84ba...b6fce1912dd8 [13:37:55] *** Parts: travis-ci (~travis-ci@ec2-54-81-11-238.compute-1.amazonaws.com) () [13:54:18] darsto: Thank you and appreciate all your help in clarifying my doubts. [14:12:11] I just cleaned up and added some cards to the bdev trello board because peluse is on vacation: https://trello.com/b/LnORPCpt/bdev [14:12:44] the highest priority ones in my mind are https://trello.com/c/yl42Hq1X and https://trello.com/c/2eVZvNKy [14:21:05] *** Quits: lhodev_ (~lhodev@inet-hqmc06-o.oracle.com) (Remote host closed the connection) [14:21:44] *** Joins: lhodev (~lhodev@66-90-218-190.dyn.grandenetworks.net) [15:23:07] *** Joins: dlw (~Thunderbi@114.252.34.129) [15:46:32] *** Joins: Shuhei (caf6fc61@gateway/web/freenode/ip.202.246.252.97) [15:48:10] *** Quits: dlw (~Thunderbi@114.252.34.129) (Ping timeout: 260 seconds) [16:57:47] *** Quits: tomzawadzki (~tomzawadz@192.55.54.42) (Ping timeout: 256 seconds) [17:03:42] bwalker, jimharris: if you get a chance, please check out the blobstore freeze patch: https://review.gerrithub.io/#/c/spdk/spdk/+/399366/ [17:03:56] I made a comment on the latest rev, but I'm not sure if I'm on the right track [17:04:43] *** Joins: nKumar_ (sid239884@gateway/web/irccloud.com/x-hiqvqekszxptbwez) [17:06:18] *** Quits: nKumar (sid239884@gateway/web/irccloud.com/x-bczbwisazlxnwxlp) (Ping timeout: 265 seconds) [17:06:19] *** nKumar_ is now known as nKumar [17:12:49] *** Quits: ChanServ (ChanServ@services.) (*.net *.split) [17:33:57] *** Joins: ChanServ (ChanServ@services.) [17:33:57] *** tolkien.freenode.net sets mode: +o ChanServ [17:38:15] *** Quits: Shuhei (caf6fc61@gateway/web/freenode/ip.202.246.252.97) (Ping timeout: 260 seconds) [17:41:40] *** Joins: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) [17:41:41] (spdk/master) blobstore: Change behaviour of dirty bit (Piotr Pelplinski) [17:41:41] Diff URL: https://github.com/spdk/spdk/compare/88168dd8b8e6...bc8f2cd90f4d [17:41:41] *** Parts: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) () [17:42:41] *** Quits: darsto (~darsto@89-68-112-135.dynamic.chello.pl) (Ping timeout: 276 seconds) [17:44:58] *** Joins: darsto (~darsto@89-68-112-135.dynamic.chello.pl) [17:54:34] *** Quits: Johnson_ (0cda5282@gateway/web/freenode/ip.12.218.82.130) (Ping timeout: 260 seconds) [17:56:35] *** Joins: travis-ci (~travis-ci@ec2-54-80-51-74.compute-1.amazonaws.com) [17:56:36] (spdk/master) test/vhost: Use json configuration file in vhost fiotest. (Pawel Niedzwiecki) [17:56:36] Diff URL: https://github.com/spdk/spdk/compare/bc8f2cd90f4d...035f490d657a [17:56:36] *** Parts: travis-ci (~travis-ci@ec2-54-80-51-74.compute-1.amazonaws.com) () [18:03:40] *** Joins: guerby_ (~guerby@ip165.tetaneutral.net) [18:04:40] *** Quits: guerby (~guerby@april/board/guerby) (Read error: Connection reset by peer) [18:05:35] *** Joins: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) [18:05:36] (spdk/master) test/vhost: Remove vhost configuration file from readonly test (Pawel Niedzwiecki) [18:05:37] Diff URL: https://github.com/spdk/spdk/compare/035f490d657a...14edf49a7007 [18:05:37] *** Parts: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) () [18:05:53] *** Joins: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) [18:05:54] (spdk/master) test/vhost: Remove vhost configuration file from initiator test (Pawel Niedzwiecki) [18:05:54] Diff URL: https://github.com/spdk/spdk/compare/14edf49a7007...c2b1de2ea6cd [18:05:54] *** Parts: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) () [18:06:28] *** Joins: travis-ci (~travis-ci@ec2-54-81-11-238.compute-1.amazonaws.com) [18:06:29] (spdk/master) test/vhost: Remove vhost configuration file from lvol test (Pawel Niedzwiecki) [18:06:29] Diff URL: https://github.com/spdk/spdk/compare/c2b1de2ea6cd...06872158843d [18:06:29] *** Parts: travis-ci (~travis-ci@ec2-54-81-11-238.compute-1.amazonaws.com) () [18:08:57] *** Joins: dlw (~Thunderbi@114.255.44.143) [18:48:26] *** Quits: dlw (~Thunderbi@114.255.44.143) (Ping timeout: 276 seconds) [18:48:46] *** Joins: dlw (~Thunderbi@114.255.44.143) [19:44:01] *** Quits: dlw (~Thunderbi@114.255.44.143) (Ping timeout: 256 seconds) [19:44:23] *** Joins: dlw (~Thunderbi@114.255.44.143) [21:11:24] *** Quits: johnmeneghini (~johnmeneg@pool-100-0-53-181.bstnma.fios.verizon.net) (Quit: Leaving.) [22:30:05] *** Quits: darsto (~darsto@89-68-112-135.dynamic.chello.pl) (Ping timeout: 260 seconds) [22:34:41] *** Joins: darsto (~darsto@89-68-112-135.dynamic.chello.pl) [22:35:27] *** Joins: Shuhei (caf6fc61@gateway/web/freenode/ip.202.246.252.97) [22:54:47] *** Quits: darsto (~darsto@89-68-112-135.dynamic.chello.pl) (Ping timeout: 256 seconds) [22:55:01] *** Joins: darsto (~darsto@89-68-112-135.dynamic.chello.pl) [23:00:32] *** Joins: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) [23:00:33] (spdk/master) spdk_ioctl: define nvme_ctrlr/bdev in internal .h (Liu Xiaodong) [23:00:33] Diff URL: https://github.com/spdk/spdk/compare/5627cfd0003c...47c7470dbf78 [23:00:33] *** Parts: travis-ci (~travis-ci@ec2-184-73-117-198.compute-1.amazonaws.com) () [23:05:50] *** Quits: darsto (~darsto@89-68-112-135.dynamic.chello.pl) (Ping timeout: 276 seconds) [23:10:13] *** Joins: darsto (~darsto@89-68-112-135.dynamic.chello.pl) [23:17:30] *** guerby_ is now known as guerby [23:17:34] *** Quits: guerby (~guerby@ip165.tetaneutral.net) (Changing host) [23:17:34] *** Joins: guerby (~guerby@april/board/guerby) [23:26:17] *** Quits: darsto (~darsto@89-68-112-135.dynamic.chello.pl) (Ping timeout: 248 seconds) [23:31:14] *** Joins: darsto (~darsto@89-68-112-135.dynamic.chello.pl) [23:50:27] *** Quits: darsto (~darsto@89-68-112-135.dynamic.chello.pl) (Ping timeout: 240 seconds) [23:55:36] *** Joins: darsto (~darsto@89-68-112-135.dynamic.chello.pl)